Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Not able to fetch post #57

Open
shivam-patil-DAX opened this issue Jul 15, 2024 · 3 comments
Open

Not able to fetch post #57

shivam-patil-DAX opened this issue Jul 15, 2024 · 3 comments

Comments

@shivam-patil-DAX
Copy link

I am using DownloadVideosBySubreddit and the function cannot fetch post hours on end is there a limit of some kind per day?? https://jackhammer.pythonanywhere.com//reddit/subreddit/videos

@Ayush-Mann-0
Copy link

same issue , i think https://jackhammer.pythonanywhere.com//reddit/subreddit/videos is not working

@asciidude
Copy link

asciidude commented Aug 25, 2024

It's likely not a rate limit as the rate limit allows for 100 RPM.
Reddit has a publicly available JSON API you could scrape data from, just add /.json to the end of a URL (eg. r/cats/.json)
This could eliminate issues you're facing by using the direct link and downloading from there.

@asciidude
Copy link

asciidude commented Aug 25, 2024

Update: I tried just 10 posts and it depends on how many posts you're fetching.
This adds an extremely long time before completing the fetching based off of the quantity fetched and I believe anything over 10 posts will result in a failure. It took roughly 5-10 minutes, which is probably 5x longer with videos.
Heavily recommend opting for scraping the JSON data.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants