pyscrolller

NOTE: This project has been extended into another generic project called Database Scraper (dbscr)

A CLI Tool

Scraper and downloader for https://www.Scrolller.com
Written in: Python 3

DISCLAIMER

• The intention of this project is soleley educational
• You can learn webscraping through my different projects
• I am not helding any responsibility on any upcoming controversies/copyright issues
• Making use of my open-source projects illegally does not count as my responsibility
• Be responsible and abide all the rules and regulations of your country

Instruction Video on Youtube.

No plans to release soon.

Prerequisite

• OS Requirement: tested on Windows 10

Snapshots

• Menu
  
• Downloading "memes" subreddit
• Stat before downloading "memes" subreddit

Usage

Source Code + Command Line Call = Simple CLI

1. Clone the repository
2. Create and open a textfile named list.txt under the cloned repository
3. Put your url links of papers and journals and save list.txt
4. Open the Windows Terminal (preferred)/ Powershell / command prompt inside cloned directory
5. Install dependencies using pip install -r requirements.txt
6. Type in "python pyscrolller.py -s SUBREDDITNAME [-d / --download]" and hit enter
7. A step to automation ;)

Source Code:

In the same repository

Version History

• v2.0 : Using Post request (very much faster than previous version)
• v1.0 : initial version - using Selenium (mimicing the firefox browser)

Thank You

Do star and share