Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[BUG] PRAW Error Code 429 #910

Open
3 tasks done
GarethFreeman opened this issue Jul 11, 2023 · 57 comments
Open
3 tasks done

[BUG] PRAW Error Code 429 #910

GarethFreeman opened this issue Jul 11, 2023 · 57 comments
Labels
bug Something isn't working

Comments

@GarethFreeman
Copy link

GarethFreeman commented Jul 11, 2023

  • I am reporting a bug.
  • I am running the latest version of BDfR
  • I have read the Opening an issue

Description

I am trying to rip a reddit user's submitted posts but keep getting blocked by PRAW, I've also tried updating with no success. It does work sometimes but it much slower than usual.

Command

py -3 -m bdfr download C:\bdfrips\tti --user TameTheseImpalas --submitted

Environment (please complete the following information)

  • OS: Windows 10
  • Python version: 3.10

Logs

py -3 -m bdfr download C:\bdfrips\tti --user TameTheseImpalas --submitted
[2023-07-11 19:55:00,020 - bdfr.connector - ERROR] - User TameTheseImpalas failed to be retrieved due to a PRAW exception: received 429 HTTP response

@GarethFreeman GarethFreeman added the bug Something isn't working label Jul 11, 2023
@Serene-Arc
Copy link
Owner

Please supply the logs. They are not optional

@KylarZeppeli
Copy link

I got this error as well while downloading a certain subreddit. The program quit prematurely right after it showed the error.
Strangely, I didn't get the 6 minute delay on this one but got the 429 error instead.

Command I used: bdfr-download . -s "traps"
Here's my log for the above command:
[2023-07-12 12:39:58,479 - bdfr.connector - DEBUG] - Disabling the following modules:
[2023-07-12 12:39:58,479 - bdfr.connector - Level 9] - Created download filter
[2023-07-12 12:39:58,479 - bdfr.connector - Level 9] - Created time filter
[2023-07-12 12:39:58,479 - bdfr.connector - Level 9] - Created sort filter
[2023-07-12 12:39:58,480 - bdfr.connector - Level 9] - Create file name formatter
[2023-07-12 12:39:58,481 - bdfr.connector - DEBUG] - Using unauthenticated Reddit instance
[2023-07-12 12:39:58,481 - bdfr.connector - Level 9] - Created site authenticator
[2023-07-12 12:39:58,969 - bdfr.connector - DEBUG] - Added submissions from subreddit traps
[2023-07-12 12:39:58,969 - bdfr.connector - Level 9] - Retrieved subreddits
[2023-07-12 12:39:58,969 - bdfr.connector - Level 9] - Retrieved multireddits
[2023-07-12 12:39:58,969 - bdfr.connector - Level 9] - Retrieved user data
[2023-07-12 12:39:58,969 - bdfr.connector - Level 9] - Retrieved submissions for given links
[2023-07-12 12:40:10,419 - bdfr.downloader - DEBUG] - Attempting to download submission f7kopk
[2023-07-12 12:40:10,420 - bdfr.downloader - DEBUG] - Using SelfPost with url https://www.reddit.com/r/traps/comments/f7kopk/hello_and_welcome_please_read_our_rules_before/
[2023-07-12 12:40:20,552 - bdfr.downloader - DEBUG] - File /tmp/traps/DELETED_Hello and welcome. Please READ OUR RULES before posting. Discord link is in the sidebar and in this post. If your post does not appear contact mods!_f7kopk.txt from submission f7kopk already exists, continuing
[2023-07-12 12:40:20,552 - bdfr.downloader - INFO] - Downloaded submission f7kopk from traps
[2023-07-12 12:40:20,552 - bdfr.downloader - DEBUG] - Attempting to download submission 14xsnsd
[2023-07-12 12:40:20,552 - bdfr.downloader - DEBUG] - Using SelfPost with url https://www.reddit.com/r/traps/comments/14xsnsd/modmail_replies_are_delayed_just_an_fyi/
[2023-07-12 12:40:30,686 - bdfr.downloader - DEBUG] - File /tmp/traps/wills731_Modmail replies are delayed. Just an FYI_14xsnsd.txt from submission 14xsnsd already exists, continuing
[2023-07-12 12:40:30,686 - bdfr.downloader - INFO] - Downloaded submission 14xsnsd from traps
[2023-07-12 12:40:30,686 - bdfr.downloader - DEBUG] - Attempting to download submission 14xlm9w
[2023-07-12 12:40:30,686 - bdfr.downloader - DEBUG] - Using Redgifs with url https://v3.redgifs.com/watch/gorgeousruddyvenomoussnake
[2023-07-12 12:40:31,302 - bdfr.downloader - DEBUG] - File /tmp/traps/vanillalindsay_Are you pulling out or cumming inside on the first date? 😋_14xlm9w.mp4 from submission 14xlm9w already exists, continuing
[2023-07-12 12:40:31,302 - bdfr.downloader - INFO] - Downloaded submission 14xlm9w from traps
[2023-07-12 12:40:31,303 - bdfr.downloader - DEBUG] - Attempting to download submission 14xm6vy
[2023-07-12 12:40:31,303 - bdfr.downloader - DEBUG] - Using Imgur with url https://i.imgur.com/5qjDMa5.gifv
[2023-07-12 12:40:31,496 - bdfr.downloader - ERROR] - Site Imgur failed to download submission 14xm6vy: Server responded with 404 at https://api.imgur.com/3/image/5qjDMa5
[2023-07-12 12:40:31,497 - bdfr.downloader - DEBUG] - Attempting to download submission 14xr2wn
[2023-07-12 12:40:31,498 - bdfr.downloader - DEBUG] - Using Imgur with url https://i.imgur.com/1bJU9sb.gifv
[2023-07-12 12:40:31,922 - bdfr.downloader - ERROR] - Site Imgur failed to download submission 14xr2wn: Server responded with 404 at https://api.imgur.com/3/image/1bJU9sb
[2023-07-12 12:40:31,923 - bdfr.downloader - DEBUG] - Attempting to download submission 14xjurx
[2023-07-12 12:40:31,923 - bdfr.downloader - DEBUG] - Using Imgur with url https://i.imgur.com/6BKnnHt.gifv
[2023-07-12 12:40:32,112 - bdfr.downloader - ERROR] - Site Imgur failed to download submission 14xjurx: Server responded with 404 at https://api.imgur.com/3/image/6BKnnHt
[2023-07-12 12:40:32,113 - bdfr.downloader - DEBUG] - Attempting to download submission 14xl0pt
[2023-07-12 12:40:32,114 - bdfr.downloader - DEBUG] - Using Direct with url https://i.redd.it/409vm12lkibb1.jpg
[2023-07-12 12:40:32,114 - bdfr.downloader - DEBUG] - File /tmp/traps/taylahg24_What do you think of redheads? 🥰_14xl0pt.jpg from submission 14xl0pt already exists, continuing
[2023-07-12 12:40:32,114 - bdfr.downloader - INFO] - Downloaded submission 14xl0pt from traps
[2023-07-12 12:40:32,114 - bdfr.downloader - DEBUG] - Attempting to download submission 14xpug3
[2023-07-12 12:40:32,114 - bdfr.downloader - DEBUG] - Using Direct with url https://i.redd.it/xnp7069hhibb1.gif
[2023-07-12 12:40:32,114 - bdfr.downloader - DEBUG] - File /tmp/traps/JaybaesunOC_Me and who?_14xpug3.gif from submission 14xpug3 already exists, continuing
[2023-07-12 12:40:32,114 - bdfr.downloader - INFO] - Downloaded submission 14xpug3 from traps
[2023-07-12 12:40:32,114 - bdfr.downloader - DEBUG] - Attempting to download submission 14xil8u
[2023-07-12 12:40:32,114 - bdfr.downloader - DEBUG] - Using Direct with url https://i.redd.it/fljdftiqyhbb1.jpg
[2023-07-12 12:40:32,115 - bdfr.downloader - DEBUG] - File /tmp/traps/Saskia_and_Sasha_Wanna come play in our secret garden? 😏 You can play with us, if we can play with you 😈_14xil8u.jpg from submission 14xil8u already exists, continuing
[2023-07-12 12:40:32,115 - bdfr.downloader - INFO] - Downloaded submission 14xil8u from traps
[2023-07-12 12:40:32,115 - bdfr.downloader - DEBUG] - Attempting to download submission 14x2mck
[2023-07-12 12:40:32,115 - bdfr.downloader - DEBUG] - Using Redgifs with url https://v3.redgifs.com/watch/lametrueambushbug
[2023-07-12 12:40:32,443 - bdfr.downloader - DEBUG] - File /tmp/traps/jessaPinkgirl_would you cum inside me? be honest 😏_14x2mck.mp4 from submission 14x2mck already exists, continuing
[2023-07-12 12:40:32,443 - bdfr.downloader - INFO] - Downloaded submission 14x2mck from traps
[2023-07-12 12:40:32,443 - bdfr.downloader - DEBUG] - Attempting to download submission 14xhsjn
[2023-07-12 12:40:32,443 - bdfr.downloader - DEBUG] - Using Direct with url https://i.redd.it/97kv8zvvqhbb1.jpg
[2023-07-12 12:40:32,444 - bdfr.downloader - DEBUG] - File /tmp/traps/ov-ary_say hi if you’d cum inside me 😉_14xhsjn.jpg from submission 14xhsjn already exists, continuing
[2023-07-12 12:40:32,444 - bdfr.downloader - INFO] - Downloaded submission 14xhsjn from traps
[2023-07-12 12:40:32,444 - bdfr.downloader - DEBUG] - Attempting to download submission 14x0z31
[2023-07-12 12:40:32,444 - bdfr.downloader - DEBUG] - Using Imgur with url https://i.imgur.com/wKmOtVz.gifv
[2023-07-12 12:40:32,657 - bdfr.downloader - ERROR] - Site Imgur failed to download submission 14x0z31: Server responded with 404 at https://api.imgur.com/3/image/wKmOtVz
[2023-07-12 12:40:32,658 - bdfr.downloader - DEBUG] - Attempting to download submission 14x1wd8
[2023-07-12 12:40:32,658 - bdfr.downloader - DEBUG] - Using Direct with url https://i.redd.it/zqm52op87ebb1.gif
[2023-07-12 12:40:32,658 - bdfr.downloader - DEBUG] - File /tmp/traps/MyMyMarceline_Say hi if you’d still fuck a trans girl even if she’s chubby 😳🖤_14x1wd8.gif from submission 14x1wd8 already exists, continuing
[2023-07-12 12:40:32,659 - bdfr.downloader - INFO] - Downloaded submission 14x1wd8 from traps
[2023-07-12 12:40:32,659 - bdfr.downloader - DEBUG] - Attempting to download submission 14x0855
[2023-07-12 12:40:32,659 - bdfr.downloader - DEBUG] - Using Direct with url https://i.redd.it/3qs22nt2wdbb1.jpg
[2023-07-12 12:40:32,659 - bdfr.downloader - DEBUG] - File /tmp/traps/vasyaroe_hii can i send you a dick pic 🫣💕_14x0855.jpg from submission 14x0855 already exists, continuing
[2023-07-12 12:40:32,659 - bdfr.downloader - INFO] - Downloaded submission 14x0855 from traps
[2023-07-12 12:40:32,659 - bdfr.downloader - DEBUG] - Attempting to download submission 14xro70
[2023-07-12 12:40:32,659 - bdfr.downloader - DEBUG] - Using Redgifs with url https://i.redgifs.com/i/muddychubbyandalusianhorse.jpg
[2023-07-12 12:40:32,846 - bdfr.downloader - DEBUG] - File /tmp/traps/AlsoAshley_Getting out more this year has been fun... Maybe you can ask me out if you see me 😜_14xro70.jpg from submission 14xro70 already exists, continuing
[2023-07-12 12:40:32,846 - bdfr.downloader - INFO] - Downloaded submission 14xro70 from traps
[2023-07-12 12:40:32,846 - bdfr.downloader - DEBUG] - Attempting to download submission 14x21nu
[2023-07-12 12:40:32,846 - bdfr.downloader - DEBUG] - Using Imgur with url https://i.imgur.com/zR5gOD9.gifv
[2023-07-12 12:40:33,052 - bdfr.downloader - ERROR] - Site Imgur failed to download submission 14x21nu: Server responded with 404 at https://api.imgur.com/3/image/zR5gOD9
[2023-07-12 12:40:33,053 - bdfr.downloader - DEBUG] - Attempting to download submission 14xrc3q
[2023-07-12 12:40:33,054 - bdfr.downloader - DEBUG] - Using Direct with url https://i.redd.it/k7arkq32wjbb1.jpg
[2023-07-12 12:40:33,054 - bdfr.downloader - DEBUG] - File /tmp/traps/genderflipflops_smash or pass? :)_14xrc3q.jpg from submission 14xrc3q already exists, continuing
[2023-07-12 12:40:33,054 - bdfr.downloader - INFO] - Downloaded submission 14xrc3q from traps
[2023-07-12 12:40:33,054 - bdfr.downloader - DEBUG] - Attempting to download submission 14x9ki3
[2023-07-12 12:40:33,054 - bdfr.downloader - DEBUG] - Using Imgur with url https://i.imgur.com/zCtwTVb.gifv
[2023-07-12 12:40:33,243 - bdfr.downloader - ERROR] - Site Imgur failed to download submission 14x9ki3: Server responded with 404 at https://api.imgur.com/3/image/zCtwTVb
[2023-07-12 12:40:33,244 - bdfr.downloader - DEBUG] - Attempting to download submission 14xs82g
[2023-07-12 12:40:33,244 - bdfr.downloader - DEBUG] - Using Direct with url https://i.redd.it/qfw68c6x1kbb1.jpg
[2023-07-12 12:40:33,244 - bdfr.downloader - DEBUG] - File /tmp/traps/muasshole_Do you like my ‘something extra’ ?_14xs82g.jpg from submission 14xs82g already exists, continuing
[2023-07-12 12:40:33,244 - bdfr.downloader - INFO] - Downloaded submission 14xs82g from traps
[2023-07-12 12:40:33,244 - bdfr.downloader - DEBUG] - Attempting to download submission 14xmhgm
[2023-07-12 12:40:33,245 - bdfr.downloader - DEBUG] - Using Direct with url https://i.redd.it/89j4g7ttwibb1.jpg
[2023-07-12 12:40:33,245 - bdfr.downloader - DEBUG] - File /tmp/traps/itslexieNL_Can I sit on your lap? 🥵🔥_14xmhgm.jpg from submission 14xmhgm already exists, continuing
[2023-07-12 12:40:33,245 - bdfr.downloader - INFO] - Downloaded submission 14xmhgm from traps
[2023-07-12 12:40:33,245 - bdfr.downloader - DEBUG] - Attempting to download submission 14x4vry
[2023-07-12 12:40:33,245 - bdfr.downloader - DEBUG] - Using Direct with url https://i.redd.it/rsc7hmp0rebb1.jpg
[2023-07-12 12:40:33,245 - bdfr.downloader - DEBUG] - File /tmp/traps/my-secret-gf_Say hi if u wanna put ur dick inside me! ✌️_14x4vry.jpg from submission 14x4vry already exists, continuing
[2023-07-12 12:40:33,245 - bdfr.downloader - INFO] - Downloaded submission 14x4vry from traps
[2023-07-12 12:40:33,245 - bdfr.downloader - DEBUG] - Attempting to download submission 14xi2hi
[2023-07-12 12:40:33,245 - bdfr.downloader - DEBUG] - Using Direct with url https://i.redd.it/rzujzivlthbb1.jpg
[2023-07-12 12:40:33,246 - bdfr.downloader - DEBUG] - File /tmp/traps/iammery_Fuck, marry or breed? 😝_14xi2hi.jpg from submission 14xi2hi already exists, continuing
[2023-07-12 12:40:33,246 - bdfr.downloader - INFO] - Downloaded submission 14xi2hi from traps
[2023-07-12 12:40:33,246 - bdfr.downloader - DEBUG] - Attempting to download submission 14xp0qo
[2023-07-12 12:40:33,246 - bdfr.downloader - DEBUG] - Using Direct with url https://i.redd.it/dq1108d6gjbb1.gif
[2023-07-12 12:40:33,246 - bdfr.downloader - DEBUG] - File /tmp/traps/MinkaSummers_Do you want this in your mouth straight boy? Be honest!_14xp0qo.gif from submission 14xp0qo already exists, continuing
[2023-07-12 12:40:33,246 - bdfr.downloader - INFO] - Downloaded submission 14xp0qo from traps
[2023-07-12 12:40:33,246 - bdfr.downloader - DEBUG] - Attempting to download submission 14xo5ua
[2023-07-12 12:40:33,247 - bdfr.downloader - DEBUG] - Using Redgifs with url https://www.redgifs.com/watch/vigilanthandsomeafricanfisheagle
[2023-07-12 12:40:33,572 - bdfr.downloader - DEBUG] - File /tmp/traps/anoblirigj_Did you stop scrolling now?_14xo5ua.mp4 from submission 14xo5ua already exists, continuing
[2023-07-12 12:40:33,572 - bdfr.downloader - INFO] - Downloaded submission 14xo5ua from traps
[2023-07-12 12:40:33,572 - bdfr.downloader - DEBUG] - Attempting to download submission 14xuuu2
[2023-07-12 12:40:33,572 - bdfr.downloader - DEBUG] - Using Imgur with url https://i.imgur.com/uKuHbVp.gifv
[2023-07-12 12:40:33,796 - bdfr.downloader - ERROR] - Site Imgur failed to download submission 14xuuu2: Server responded with 404 at https://api.imgur.com/3/image/uKuHbVp
[2023-07-12 12:40:33,797 - bdfr.downloader - DEBUG] - Attempting to download submission 14xsexs
[2023-07-12 12:40:33,797 - bdfr.downloader - DEBUG] - Using Redgifs with url https://www.redgifs.com/watch/superbunsungindri
[2023-07-12 12:40:34,134 - bdfr.downloader - DEBUG] - File /tmp/traps/Ecstatic-Start-9245_Spit or swallow?_14xsexs.mp4 from submission 14xsexs already exists, continuing
[2023-07-12 12:40:34,134 - bdfr.downloader - INFO] - Downloaded submission 14xsexs from traps
[2023-07-12 12:40:34,134 - bdfr.downloader - DEBUG] - Attempting to download submission 14xa9cm
[2023-07-12 12:40:34,134 - bdfr.downloader - DEBUG] - Using Direct with url https://i.redd.it/tvkbwlh7vfbb1.jpg
[2023-07-12 12:40:34,134 - bdfr.downloader - DEBUG] - File /tmp/traps/MichelleAlter_I don’t think my bikini is big enough_14xa9cm.jpg from submission 14xa9cm already exists, continuing
[2023-07-12 12:40:34,135 - bdfr.downloader - INFO] - Downloaded submission 14xa9cm from traps
[2023-07-12 12:40:34,135 - bdfr.downloader - DEBUG] - Attempting to download submission 14xt3f4
[2023-07-12 12:40:34,135 - bdfr.downloader - DEBUG] - Using Redgifs with url https://www.redgifs.com/watch/pungentfunctionalhadrosaurus
[2023-07-12 12:40:34,477 - bdfr.downloader - DEBUG] - File /tmp/traps/jordxdollx_Wanna fuck my tight t-girl ass?_14xt3f4.mp4 from submission 14xt3f4 already exists, continuing
[2023-07-12 12:40:34,477 - bdfr.downloader - INFO] - Downloaded submission 14xt3f4 from traps
[2023-07-12 12:40:34,477 - bdfr.downloader - DEBUG] - Attempting to download submission 14xr170
[2023-07-12 12:40:34,477 - bdfr.downloader - DEBUG] - Using Redgifs with url https://www.redgifs.com/watch/tanopaqueloris
[2023-07-12 12:40:35,303 - bdfr.downloader - DEBUG] - Written file to /tmp/traps/PartTime_Femboy_If you see this growing under my dress, what’s your next move?👀_14xr170.mp4
[2023-07-12 12:40:35,303 - bdfr.downloader - DEBUG] - Hash added to master list: 984aa4fb156c7378dadae3d121811a7b
[2023-07-12 12:40:35,303 - bdfr.downloader - INFO] - Downloaded submission 14xr170 from traps
[2023-07-12 12:40:35,303 - bdfr.downloader - DEBUG] - Attempting to download submission 14xrv3e
[2023-07-12 12:40:35,303 - bdfr.downloader - DEBUG] - Using Imgur with url https://i.imgur.com/our8l09.gifv
[2023-07-12 12:40:35,652 - bdfr.downloader - ERROR] - Site Imgur failed to download submission 14xrv3e: Server responded with 404 at https://api.imgur.com/3/image/our8l09
[2023-07-12 12:40:35,653 - bdfr.downloader - DEBUG] - Attempting to download submission 14xt5d2
[2023-07-12 12:40:35,654 - bdfr.downloader - DEBUG] - Using Redgifs with url https://www.redgifs.com/watch/mysteriousleangartersnake
[2023-07-12 12:40:36,530 - bdfr.downloader - DEBUG] - Written file to /tmp/traps/Quick-Play_Femboy_Let me Cum on your face💕_14xt5d2.mp4
[2023-07-12 12:40:36,531 - bdfr.downloader - DEBUG] - Hash added to master list: 0809a054a64c19a88bf1bd42592722e1
[2023-07-12 12:40:36,531 - bdfr.downloader - INFO] - Downloaded submission 14xt5d2 from traps
[2023-07-12 12:40:36,531 - bdfr.downloader - DEBUG] - Attempting to download submission 14xosim
[2023-07-12 12:40:36,531 - bdfr.downloader - DEBUG] - Using Direct with url https://i.redd.it/fzads4ugejbb1.jpg
[2023-07-12 12:40:36,531 - bdfr.downloader - DEBUG] - File /tmp/traps/MaxHamster69_any straight guys want to play with my dick? 💕_14xosim.jpg from submission 14xosim already exists, continuing
[2023-07-12 12:40:36,531 - bdfr.downloader - INFO] - Downloaded submission 14xosim from traps
[2023-07-12 12:40:36,531 - bdfr.downloader - DEBUG] - Attempting to download submission 14x44gi
[2023-07-12 12:40:36,531 - bdfr.downloader - DEBUG] - Using Imgur with url https://i.imgur.com/WfmqQlm.gifv
[2023-07-12 12:40:36,863 - bdfr.downloader - ERROR] - Site Imgur failed to download submission 14x44gi: Server responded with 404 at https://api.imgur.com/3/image/WfmqQlm
[2023-07-12 12:40:36,864 - bdfr.downloader - DEBUG] - Attempting to download submission 14xobzr
[2023-07-12 12:40:36,864 - bdfr.downloader - DEBUG] - Using Redgifs with url https://www.redgifs.com/watch/notedinsignificantfly
[2023-07-12 12:40:37,227 - bdfr.downloader - DEBUG] - File /tmp/traps/nicolexhunt_Can I trap you with my big eyes? 🥹😌_14xobzr.mp4 from submission 14xobzr already exists, continuing
[2023-07-12 12:40:37,228 - bdfr.downloader - INFO] - Downloaded submission 14xobzr from traps
[2023-07-12 12:40:37,228 - bdfr.downloader - DEBUG] - Attempting to download submission 14xpffg
[2023-07-12 12:40:37,228 - bdfr.downloader - DEBUG] - Using Direct with url https://i.redd.it/0x011yj2jjbb1.gif
[2023-07-12 12:40:37,228 - bdfr.downloader - DEBUG] - File /tmp/traps/tsjianna_Would you stick your dick inside?_14xpffg.gif from submission 14xpffg already exists, continuing
[2023-07-12 12:40:37,228 - bdfr.downloader - INFO] - Downloaded submission 14xpffg from traps
[2023-07-12 12:40:37,228 - bdfr.downloader - DEBUG] - Attempting to download submission 14xhr3k
[2023-07-12 12:40:37,228 - bdfr.downloader - DEBUG] - Using Gallery with url https://www.reddit.com/gallery/14xhr3k
[2023-07-12 12:40:37,558 - bdfr.file_name_formatter - Level 9] - Formatting filename with index 1
[2023-07-12 12:40:37,558 - bdfr.file_name_formatter - Level 9] - Formatting filename with index 2
[2023-07-12 12:40:37,559 - bdfr.downloader - DEBUG] - File /tmp/traps/eevie_chan_If you only had to choose one, front or back?_14xhr3k_1.jpg from submission 14xhr3k already exists, continuing
[2023-07-12 12:40:37,559 - bdfr.downloader - DEBUG] - File /tmp/traps/eevie_chan_If you only had to choose one, front or back?_14xhr3k_2.jpg from submission 14xhr3k already exists, continuing
[2023-07-12 12:40:37,559 - bdfr.downloader - INFO] - Downloaded submission 14xhr3k from traps
[2023-07-12 12:40:37,559 - bdfr.downloader - DEBUG] - Attempting to download submission 14x6muz
[2023-07-12 12:40:37,559 - bdfr.downloader - DEBUG] - Using Direct with url https://i.redd.it/s183oc9a3fbb1.jpg
[2023-07-12 12:40:37,559 - bdfr.downloader - DEBUG] - File /tmp/traps/tsaliyahh_Do we have time to play with the whip … or should we just get to business? 😈_14x6muz.jpg from submission 14x6muz already exists, continuing
[2023-07-12 12:40:37,559 - bdfr.downloader - INFO] - Downloaded submission 14x6muz from traps
[2023-07-12 12:40:37,559 - bdfr.downloader - DEBUG] - Attempting to download submission 14xdmqd
[2023-07-12 12:40:37,559 - bdfr.downloader - DEBUG] - Using Redgifs with url https://www.redgifs.com/watch/warmheartedbrownbrahmanbull
[2023-07-12 12:40:37,906 - bdfr.downloader - DEBUG] - File /tmp/traps/pierbi_say hi if you like what im been hiding 😳_14xdmqd.mp4 from submission 14xdmqd already exists, continuing
[2023-07-12 12:40:37,906 - bdfr.downloader - INFO] - Downloaded submission 14xdmqd from traps
[2023-07-12 12:40:37,906 - bdfr.downloader - DEBUG] - Attempting to download submission 14xmri2
[2023-07-12 12:40:37,907 - bdfr.downloader - DEBUG] - Using Redgifs with url https://i.redgifs.com/i/strictemptyglowworm.jpg
[2023-07-12 12:40:38,091 - bdfr.downloader - DEBUG] - File /tmp/traps/cheshirekitten11_It is an invitation~_14xmri2.jpg from submission 14xmri2 already exists, continuing
[2023-07-12 12:40:38,091 - bdfr.downloader - INFO] - Downloaded submission 14xmri2 from traps
[2023-07-12 12:40:38,091 - bdfr.downloader - DEBUG] - Attempting to download submission 14xu50e
[2023-07-12 12:40:38,091 - bdfr.downloader - DEBUG] - Using Direct with url https://i.redd.it/msvns72dekbb1.jpg
[2023-07-12 12:40:38,428 - bdfr.downloader - DEBUG] - Written file to /tmp/traps/Irish94backpack_I hope you like sucking girl dick x_14xu50e.jpg
[2023-07-12 12:40:38,428 - bdfr.downloader - DEBUG] - Hash added to master list: d4f4034feb7ce34d8c44814b953c2a08
[2023-07-12 12:40:38,428 - bdfr.downloader - INFO] - Downloaded submission 14xu50e from traps
[2023-07-12 12:40:38,429 - bdfr.downloader - DEBUG] - Attempting to download submission 14xozxf
[2023-07-12 12:40:38,429 - bdfr.downloader - DEBUG] - Using Direct with url https://i.redd.it/o50ybi20gjbb1.jpg
[2023-07-12 12:40:38,689 - bdfr.downloader - DEBUG] - Written file to /tmp/traps/AllAccessAsianAmber_Can I be your fuck doll? 🥹_14xozxf.jpg
[2023-07-12 12:40:38,689 - bdfr.downloader - DEBUG] - Hash added to master list: 02b4c5476a9d0dd2b9a60a98e6b2ec85
[2023-07-12 12:40:38,689 - bdfr.downloader - INFO] - Downloaded submission 14xozxf from traps
[2023-07-12 12:40:38,689 - bdfr.downloader - DEBUG] - Attempting to download submission 14xn32z
[2023-07-12 12:40:38,689 - bdfr.downloader - DEBUG] - Using Direct with url https://i.redd.it/p1pcibge1jbb1.gif
[2023-07-12 12:40:39,425 - bdfr.downloader - DEBUG] - Written file to /tmp/traps/Lexxiraus_You got a vacant spot for my cock?_14xn32z.gif
[2023-07-12 12:40:39,425 - bdfr.downloader - DEBUG] - Hash added to master list: 44ff6f9eae1a7b66890f184d875744e0
[2023-07-12 12:40:39,425 - bdfr.downloader - INFO] - Downloaded submission 14xn32z from traps
[2023-07-12 12:40:39,425 - bdfr.downloader - DEBUG] - Attempting to download submission 14xnz83
[2023-07-12 12:40:39,425 - bdfr.downloader - DEBUG] - Using Direct with url https://i.redd.it/vcezegze8jbb1.jpg
[2023-07-12 12:40:39,672 - bdfr.downloader - DEBUG] - Written file to /tmp/traps/JazzzBerrry_are you enjoying the view?_14xnz83.jpg
[2023-07-12 12:40:39,672 - bdfr.downloader - DEBUG] - Hash added to master list: 13668dc8948983541df070b50f6b2847
[2023-07-12 12:40:39,672 - bdfr.downloader - INFO] - Downloaded submission 14xnz83 from traps
[2023-07-12 12:40:39,672 - bdfr.downloader - DEBUG] - Attempting to download submission 14xtzz3
[2023-07-12 12:40:39,672 - bdfr.downloader - DEBUG] - Using Imgur with url https://i.imgur.com/xtIvpCg.gifv
[2023-07-12 12:40:40,290 - bdfr.downloader - DEBUG] - Written file to /tmp/traps/Amber_hawking_Do you want me to fuck you like this?_14xtzz3.mp4
[2023-07-12 12:40:40,290 - bdfr.downloader - DEBUG] - Hash added to master list: 86f3410f26fe87ccf36c3dd1d374c2e7
[2023-07-12 12:40:40,290 - bdfr.downloader - INFO] - Downloaded submission 14xtzz3 from traps
[2023-07-12 12:40:40,290 - bdfr.downloader - DEBUG] - Attempting to download submission 14xrdi0
[2023-07-12 12:40:40,290 - bdfr.downloader - DEBUG] - Using Gallery with url https://www.reddit.com/gallery/14xrdi0
[2023-07-12 12:40:40,586 - bdfr.file_name_formatter - Level 9] - Formatting filename with index 1
[2023-07-12 12:40:40,587 - bdfr.file_name_formatter - Level 9] - Formatting filename with index 2
[2023-07-12 12:40:40,772 - bdfr.downloader - DEBUG] - Written file to /tmp/traps/Ash-lee_reddit_Would you milk my little clit or pump me full of yours? 🥛😝💕_14xrdi0_1.jpg
[2023-07-12 12:40:40,772 - bdfr.downloader - DEBUG] - Hash added to master list: e22beeb1ad24b7bfb5f34153dbce35d8
[2023-07-12 12:40:40,938 - bdfr.downloader - DEBUG] - Written file to /tmp/traps/Ash-lee_reddit_Would you milk my little clit or pump me full of yours? 🥛😝💕_14xrdi0_2.jpg
[2023-07-12 12:40:40,938 - bdfr.downloader - DEBUG] - Hash added to master list: 1532ee5e2441232f528065b84f69ac1d
[2023-07-12 12:40:40,938 - bdfr.downloader - INFO] - Downloaded submission 14xrdi0 from traps
[2023-07-12 12:40:40,938 - bdfr.downloader - DEBUG] - Attempting to download submission 14x3kfv
[2023-07-12 12:40:40,938 - bdfr.downloader - DEBUG] - Using Direct with url https://i.redd.it/z17yiyi9iebb1.png
[2023-07-12 12:40:41,216 - bdfr.downloader - DEBUG] - Written file to /tmp/traps/bootytrap69_Im that one bitch with the fat ass 😄_14x3kfv.png
[2023-07-12 12:40:41,216 - bdfr.downloader - DEBUG] - Hash added to master list: 7aab99380eca2bccb1b2359de89ed65e
[2023-07-12 12:40:41,216 - bdfr.downloader - INFO] - Downloaded submission 14x3kfv from traps
[2023-07-12 12:40:41,216 - bdfr.downloader - DEBUG] - Attempting to download submission 14xmc9c
[2023-07-12 12:40:41,216 - bdfr.downloader - DEBUG] - Using Direct with url https://i.redd.it/m1pk5vojvibb1.jpg
[2023-07-12 12:40:41,495 - bdfr.downloader - DEBUG] - Written file to /tmp/traps/JanieBlade_Can you handle me Daddy?_14xmc9c.jpg
[2023-07-12 12:40:41,496 - bdfr.downloader - DEBUG] - Hash added to master list: 68aae4b552330515879989f3b3b69e8a
[2023-07-12 12:40:41,496 - bdfr.downloader - INFO] - Downloaded submission 14xmc9c from traps
[2023-07-12 12:40:41,496 - bdfr.downloader - DEBUG] - Attempting to download submission 14xomco
[2023-07-12 12:40:41,496 - bdfr.downloader - DEBUG] - Using Direct with url https://i.redd.it/dtayjjx8djbb1.gif
[2023-07-12 12:40:42,279 - bdfr.downloader - DEBUG] - Written file to /tmp/traps/xMatthiax_My pp says Hi! ;)_14xomco.gif
[2023-07-12 12:40:42,280 - bdfr.downloader - DEBUG] - Hash added to master list: d5cf2154d945e12692a233e87b5fd00f
[2023-07-12 12:40:42,280 - bdfr.downloader - INFO] - Downloaded submission 14xomco from traps
[2023-07-12 12:40:42,280 - bdfr.downloader - DEBUG] - Attempting to download submission 14xpvqg
[2023-07-12 12:40:42,280 - bdfr.downloader - DEBUG] - Using Direct with url https://i.redd.it/q8ij19b7mjbb1.jpg
[2023-07-12 12:40:42,626 - bdfr.downloader - DEBUG] - Written file to /tmp/traps/GumzyBlutz_Ride on me or suck my tits?_14xpvqg.jpg
[2023-07-12 12:40:42,626 - bdfr.downloader - DEBUG] - Hash added to master list: e58bff99ff749cfb33ae85c396bd1d63
[2023-07-12 12:40:42,626 - bdfr.downloader - INFO] - Downloaded submission 14xpvqg from traps
[2023-07-12 12:40:42,626 - bdfr.downloader - DEBUG] - Attempting to download submission 14xoycm
[2023-07-12 12:40:42,627 - bdfr.downloader - DEBUG] - Using Redgifs with url https://www.redgifs.com/watch/chartreusetrivialaustraliancurlew
[2023-07-12 12:40:43,353 - bdfr.downloader - DEBUG] - Written file to /tmp/traps/RaiCutie_I need more in me!!!_14xoycm.mp4
[2023-07-12 12:40:43,353 - bdfr.downloader - DEBUG] - Hash added to master list: d5bd4fd90461bdb1781905148e634f9d
[2023-07-12 12:40:43,353 - bdfr.downloader - INFO] - Downloaded submission 14xoycm from traps
[2023-07-12 12:40:43,353 - bdfr.downloader - DEBUG] - Attempting to download submission 14xmxte
[2023-07-12 12:40:43,354 - bdfr.downloader - DEBUG] - Using Redgifs with url https://www.redgifs.com/watch/forthrightforestgreengermanwirehairedpointer
[2023-07-12 12:40:44,469 - bdfr.downloader - DEBUG] - Written file to /tmp/traps/LalaThePala_Just slide inside and breed me 😍🤤_14xmxte.mp4
[2023-07-12 12:40:44,469 - bdfr.downloader - DEBUG] - Hash added to master list: 50b909387c21cee3a11de3bae38c4bc0
[2023-07-12 12:40:44,469 - bdfr.downloader - INFO] - Downloaded submission 14xmxte from traps
[2023-07-12 12:40:44,470 - bdfr.downloader - DEBUG] - Attempting to download submission 14xrcbq
[2023-07-12 12:40:44,470 - bdfr.downloader - DEBUG] - Using Direct with url https://i.redd.it/4gl0nuu1wjbb1.gif
[2023-07-12 12:40:46,262 - bdfr.downloader - DEBUG] - Written file to /tmp/traps/Argyle_Fel_Selfsucking feels good, but I'd rather suck your cock_14xrcbq.gif
[2023-07-12 12:40:46,262 - bdfr.downloader - DEBUG] - Hash added to master list: 778fca6a280ec7a0e66d847246ce9e41
[2023-07-12 12:40:46,262 - bdfr.downloader - INFO] - Downloaded submission 14xrcbq from traps
[2023-07-12 12:40:46,263 - bdfr.downloader - DEBUG] - Attempting to download submission 14xtanq
[2023-07-12 12:40:46,263 - bdfr.downloader - DEBUG] - Using Redgifs with url https://www.redgifs.com/watch/unfortunatestudiousroach
[2023-07-12 12:40:47,591 - bdfr.downloader - DEBUG] - Written file to /tmp/traps/FeedNess_Initiation_14xtanq.mp4
[2023-07-12 12:40:47,591 - bdfr.downloader - DEBUG] - Hash added to master list: fe423f3c6b9875cf8f75041a5d65a3b9
[2023-07-12 12:40:47,591 - bdfr.downloader - INFO] - Downloaded submission 14xtanq from traps
[2023-07-12 12:40:47,592 - bdfr.downloader - DEBUG] - Attempting to download submission 14x9ar4
[2023-07-12 12:40:47,592 - bdfr.downloader - DEBUG] - Using Direct with url https://i.redd.it/hn6qdnsgnfbb1.gif
[2023-07-12 12:40:48,303 - bdfr.downloader - DEBUG] - Written file to /tmp/traps/Natalia_Reyyy_Hope you don't mind if my girl cock slaps your balls as I ride you_14x9ar4.gif
[2023-07-12 12:40:48,303 - bdfr.downloader - DEBUG] - Hash added to master list: d78bbd73aa7c54fc6e9b2d6d09b683fd
[2023-07-12 12:40:48,303 - bdfr.downloader - INFO] - Downloaded submission 14x9ar4 from traps
[2023-07-12 12:40:48,303 - bdfr.downloader - DEBUG] - Attempting to download submission 14xn8gk
[2023-07-12 12:40:48,304 - bdfr.downloader - DEBUG] - Using Direct with url https://i.redd.it/m3yd3khm2jbb1.jpg
[2023-07-12 12:40:48,590 - bdfr.downloader - DEBUG] - Written file to /tmp/traps/Angele_mhr_Who wants to join me?_14xn8gk.jpg
[2023-07-12 12:40:48,591 - bdfr.downloader - DEBUG] - Hash added to master list: c3e094e8b51f78ea9f20796efebc7966
[2023-07-12 12:40:48,591 - bdfr.downloader - INFO] - Downloaded submission 14xn8gk from traps
[2023-07-12 12:40:48,591 - bdfr.downloader - DEBUG] - Attempting to download submission 14xnxxz
[2023-07-12 12:40:48,591 - bdfr.downloader - DEBUG] - Using Direct with url https://i.redd.it/54agbfd68jbb1.gif
[2023-07-12 12:40:49,988 - bdfr.downloader - DEBUG] - Written file to /tmp/traps/irl_genderbender_Would your prefer taking my mouth or girl cock 😈_14xnxxz.gif
[2023-07-12 12:40:49,988 - bdfr.downloader - DEBUG] - Hash added to master list: 6e71e0c3ef3ca93ac84d8f37cde28445
[2023-07-12 12:40:49,989 - bdfr.downloader - INFO] - Downloaded submission 14xnxxz from traps
[2023-07-12 12:40:49,989 - bdfr.downloader - DEBUG] - Attempting to download submission 14xoode
[2023-07-12 12:40:49,989 - bdfr.downloader - DEBUG] - Using Direct with url https://i.redd.it/6no1tcgldjbb1.jpg
[2023-07-12 12:40:50,193 - bdfr.downloader - DEBUG] - Written file to /tmp/traps/brooDYABeL_Lick on that tip😈_14xoode.jpg
[2023-07-12 12:40:50,194 - bdfr.downloader - DEBUG] - Hash added to master list: ddbd4b8fbf3be92eb9aec1da30c5729c
[2023-07-12 12:40:50,194 - bdfr.downloader - INFO] - Downloaded submission 14xoode from traps
[2023-07-12 12:40:50,194 - bdfr.downloader - DEBUG] - Attempting to download submission 14xn94k
[2023-07-12 12:40:50,194 - bdfr.downloader - DEBUG] - Using Direct with url https://i.redd.it/cmgax61t2jbb1.jpg
[2023-07-12 12:40:50,627 - bdfr.downloader - DEBUG] - Written file to /tmp/traps/tessfinessed_100% all naturál 😘🤌🏼_14xn94k.jpg
[2023-07-12 12:40:50,627 - bdfr.downloader - DEBUG] - Hash added to master list: 5fb2a208fa5cc61d19533e09506302a1
[2023-07-12 12:40:50,627 - bdfr.downloader - INFO] - Downloaded submission 14xn94k from traps
[2023-07-12 12:40:50,628 - bdfr.downloader - DEBUG] - Attempting to download submission 14xq939
[2023-07-12 12:40:50,628 - bdfr.downloader - DEBUG] - Using Direct with url https://i.redd.it/st659xnsojbb1.jpg
[2023-07-12 12:40:50,835 - bdfr.downloader - DEBUG] - Written file to /tmp/traps/Femboy_Izzy_Boo!👻💖_14xq939.jpg
[2023-07-12 12:40:50,835 - bdfr.downloader - DEBUG] - Hash added to master list: 13a04c9f61d666f9a613a56b267e77e1
[2023-07-12 12:40:50,835 - bdfr.downloader - INFO] - Downloaded submission 14xq939 from traps
[2023-07-12 12:40:50,835 - bdfr.downloader - DEBUG] - Attempting to download submission 14xm82e
[2023-07-12 12:40:50,836 - bdfr.downloader - DEBUG] - Using Direct with url https://i.redd.it/rwcjui1nuibb1.jpg
[2023-07-12 12:40:51,134 - bdfr.downloader - DEBUG] - Written file to /tmp/traps/GalaPlacidia_Thinking what to do with you_14xm82e.jpg
[2023-07-12 12:40:51,134 - bdfr.downloader - DEBUG] - Hash added to master list: 9d6306e19f5411eedd6f831f4db7a540
[2023-07-12 12:40:51,135 - bdfr.downloader - INFO] - Downloaded submission 14xm82e from traps
[2023-07-12 12:40:51,135 - bdfr.downloader - DEBUG] - Attempting to download submission 14xrbxh
[2023-07-12 12:40:51,135 - bdfr.downloader - DEBUG] - Using Redgifs with url https://i.redgifs.com/i/bisquefoolhardypuffer.jpg
[2023-07-12 12:40:51,626 - bdfr.downloader - DEBUG] - Written file to /tmp/traps/AvaShade_If I looked at you like this would you suck my cock?_14xrbxh.jpg
[2023-07-12 12:40:51,626 - bdfr.downloader - DEBUG] - Hash added to master list: f512a1caca00555133ea851c4c3d8617
[2023-07-12 12:40:51,626 - bdfr.downloader - INFO] - Downloaded submission 14xrbxh from traps
[2023-07-12 12:40:51,627 - bdfr.downloader - DEBUG] - Attempting to download submission 14xoht4
[2023-07-12 12:40:51,627 - bdfr.downloader - DEBUG] - Using Redgifs with url https://www.redgifs.com/watch/lateastonishinggrayling
[2023-07-12 12:40:52,569 - bdfr.downloader - DEBUG] - Written file to /tmp/traps/Sassyleaf_Cumming as a girl feels soo good_14xoht4.mp4
[2023-07-12 12:40:52,570 - bdfr.downloader - DEBUG] - Hash added to master list: 2867d3028bafaf1291170847091a3f4e
[2023-07-12 12:40:52,570 - bdfr.downloader - INFO] - Downloaded submission 14xoht4 from traps
[2023-07-12 12:40:52,570 - bdfr.downloader - DEBUG] - Attempting to download submission 14xqf5n
[2023-07-12 12:40:52,570 - bdfr.downloader - DEBUG] - Using Direct with url https://i.redd.it/14oghlbypjbb1.jpg
[2023-07-12 12:40:52,730 - bdfr.downloader - DEBUG] - Written file to /tmp/traps/AlexYourFemboy_It always pops out of my skirts_14xqf5n.jpg
[2023-07-12 12:40:52,730 - bdfr.downloader - DEBUG] - Hash added to master list: 2c320798edaae3b153ef809d23573ce8
[2023-07-12 12:40:52,730 - bdfr.downloader - INFO] - Downloaded submission 14xqf5n from traps
[2023-07-12 12:40:52,730 - bdfr.downloader - DEBUG] - Attempting to download submission 14xnio3
[2023-07-12 12:40:52,730 - bdfr.downloader - DEBUG] - Using Direct with url https://i.redd.it/yjv43rrx4jbb1.jpg
[2023-07-12 12:40:52,974 - bdfr.downloader - DEBUG] - Written file to /tmp/traps/xroxywolfx_Have a nice day at work Daddy! What do you have planned for tonight? 😳_14xnio3.jpg
[2023-07-12 12:40:52,974 - bdfr.downloader - DEBUG] - Hash added to master list: 7a3ffa74940ee7ff60e073994034ab92
[2023-07-12 12:40:52,974 - bdfr.downloader - INFO] - Downloaded submission 14xnio3 from traps
[2023-07-12 12:40:52,975 - bdfr.downloader - DEBUG] - Attempting to download submission 14xr76o
[2023-07-12 12:40:52,975 - bdfr.downloader - DEBUG] - Using Direct with url https://i.redd.it/p3ai6ad5vjbb1.jpg
[2023-07-12 12:40:53,599 - bdfr.downloader - DEBUG] - Written file to /tmp/traps/cericyber_Reading through the messages you sent me_14xr76o.jpg
[2023-07-12 12:40:53,599 - bdfr.downloader - DEBUG] - Hash added to master list: ab64f3bf64db93650e1381cb5c2faafb
[2023-07-12 12:40:53,599 - bdfr.downloader - INFO] - Downloaded submission 14xr76o from traps
[2023-07-12 12:40:53,600 - bdfr.downloader - DEBUG] - Attempting to download submission 14xsr7s
[2023-07-12 12:40:53,600 - bdfr.downloader - DEBUG] - Using Gallery with url https://www.reddit.com/gallery/14xsr7s
[2023-07-12 12:40:54,320 - bdfr.file_name_formatter - Level 9] - Formatting filename with index 1
[2023-07-12 12:40:54,320 - bdfr.file_name_formatter - Level 9] - Formatting filename with index 2
[2023-07-12 12:40:54,551 - bdfr.downloader - DEBUG] - Written file to /tmp/traps/LunaBunnies1_Two cute pics :)_14xsr7s_1.png
[2023-07-12 12:40:54,552 - bdfr.downloader - DEBUG] - Hash added to master list: 59d387df94b53913c79d12216bd377b2
[2023-07-12 12:40:54,816 - bdfr.downloader - DEBUG] - Written file to /tmp/traps/LunaBunnies1_Two cute pics :)_14xsr7s_2.png
[2023-07-12 12:40:54,816 - bdfr.downloader - DEBUG] - Hash added to master list: c9865b8ceb840bb8dd82b2bbb234d82e
[2023-07-12 12:40:54,816 - bdfr.downloader - INFO] - Downloaded submission 14xsr7s from traps
[2023-07-12 12:40:54,817 - bdfr.downloader - DEBUG] - Attempting to download submission 14xrget
[2023-07-12 12:40:54,817 - bdfr.downloader - DEBUG] - Using Direct with url https://i.redd.it/3292i8otwjbb1.jpg
[2023-07-12 12:40:55,116 - bdfr.downloader - DEBUG] - Written file to /tmp/traps/LunaStarflare_Wish there was something between my legs today._14xrget.jpg
[2023-07-12 12:40:55,116 - bdfr.downloader - DEBUG] - Hash added to master list: 8db10530be3f076831668680f7c22680
[2023-07-12 12:40:55,116 - bdfr.downloader - INFO] - Downloaded submission 14xrget from traps
[2023-07-12 12:40:55,116 - bdfr.downloader - DEBUG] - Attempting to download submission 14xs7uf
[2023-07-12 12:40:55,116 - bdfr.downloader - DEBUG] - Using Direct with url https://i.redd.it/xkqsyqqv1kbb1.jpg
[2023-07-12 12:40:55,313 - bdfr.downloader - DEBUG] - Written file to /tmp/traps/twinkinpiink_your average diamond apex player_14xs7uf.jpg
[2023-07-12 12:40:55,314 - bdfr.downloader - DEBUG] - Hash added to master list: 548113326e3fd4d3325b340666518e1e
[2023-07-12 12:40:55,314 - bdfr.downloader - INFO] - Downloaded submission 14xs7uf from traps
[2023-07-12 12:40:55,314 - bdfr.downloader - DEBUG] - Attempting to download submission 14xkghn
[2023-07-12 12:40:55,314 - bdfr.downloader - DEBUG] - Using Redgifs with url https://www.redgifs.com/watch/unfoldedbigheartedheron
[2023-07-12 12:40:56,064 - bdfr.downloader - DEBUG] - Written file to /tmp/traps/pinkprincessluna_would you fuck me?_14xkghn.mp4
[2023-07-12 12:40:56,065 - bdfr.downloader - DEBUG] - Hash added to master list: 1e0c58cc3838bfb9e10d0cdddf33af78
[2023-07-12 12:40:56,065 - bdfr.downloader - INFO] - Downloaded submission 14xkghn from traps
[2023-07-12 12:40:56,065 - bdfr.downloader - DEBUG] - Attempting to download submission 14xk6c2
[2023-07-12 12:40:56,065 - bdfr.downloader - DEBUG] - Using Redgifs with url https://www.redgifs.com/watch/darkorangesnappybrontosaurus
[2023-07-12 12:40:56,930 - bdfr.downloader - DEBUG] - Written file to /tmp/traps/subhumanleech_Suck or fuck this morning? You pick :3_14xk6c2.mp4
[2023-07-12 12:40:56,931 - bdfr.downloader - DEBUG] - Hash added to master list: c05f6045751a899f47a63b034062f661
[2023-07-12 12:40:56,931 - bdfr.downloader - INFO] - Downloaded submission 14xk6c2 from traps
[2023-07-12 12:40:56,931 - bdfr.downloader - DEBUG] - Attempting to download submission 14xu1um
[2023-07-12 12:40:56,931 - bdfr.downloader - DEBUG] - Using Redgifs with url https://www.redgifs.com/watch/putridacidicmartin
[2023-07-12 12:40:58,116 - bdfr.downloader - DEBUG] - Written file to /tmp/traps/NuniCult_I know you'll feel amazing in my throat~_14xu1um.mp4
[2023-07-12 12:40:58,116 - bdfr.downloader - DEBUG] - Hash added to master list: b10d02f863f64fcb640b7c28653fb2b2
[2023-07-12 12:40:58,116 - bdfr.downloader - INFO] - Downloaded submission 14xu1um from traps
[2023-07-12 12:40:58,117 - bdfr.downloader - DEBUG] - Attempting to download submission 14xqakl
[2023-07-12 12:40:58,117 - bdfr.downloader - DEBUG] - Using Direct with url https://i.redd.it/a4z2u8g3pjbb1.jpg
[2023-07-12 12:40:58,337 - bdfr.downloader - DEBUG] - Written file to /tmp/traps/trans_mary_Would it fit in🤔🤪💦._14xqakl.jpg
[2023-07-12 12:40:58,337 - bdfr.downloader - DEBUG] - Hash added to master list: a2340cff869ab41bfa758d35e0013fda
[2023-07-12 12:40:58,337 - bdfr.downloader - INFO] - Downloaded submission 14xqakl from traps
[2023-07-12 12:40:58,338 - bdfr.downloader - DEBUG] - Attempting to download submission 14woj83
[2023-07-12 12:40:58,338 - bdfr.downloader - DEBUG] - Using Imgur with url https://i.imgur.com/IHuOuYk.gifv
[2023-07-12 12:40:58,651 - bdfr.downloader - ERROR] - Site Imgur failed to download submission 14woj83: Server responded with 404 at https://api.imgur.com/3/image/IHuOuYk
[2023-07-12 12:40:58,652 - bdfr.downloader - DEBUG] - Attempting to download submission 14xqmu6
[2023-07-12 12:40:58,652 - bdfr.downloader - DEBUG] - Using Direct with url https://i.redd.it/50u9s5xcrjbb1.gif
[2023-07-12 12:40:59,800 - bdfr.downloader - DEBUG] - Written file to /tmp/traps/thirdworldtrans00_LOVE taking a BIG DICK as a GOOD girl hehe_14xqmu6.gif
[2023-07-12 12:40:59,800 - bdfr.downloader - DEBUG] - Hash added to master list: 17327951c78051b1201c5d7489c2379b
[2023-07-12 12:40:59,800 - bdfr.downloader - INFO] - Downloaded submission 14xqmu6 from traps
[2023-07-12 12:40:59,801 - bdfr.downloader - DEBUG] - Attempting to download submission 14xq8xi
[2023-07-12 12:40:59,801 - bdfr.downloader - DEBUG] - Using Direct with url https://i.redd.it/2rdrrbbrojbb1.jpg
[2023-07-12 12:41:00,062 - bdfr.downloader - DEBUG] - Written file to /tmp/traps/BansheesAndBeasts_How do I look? 💕🥺_14xq8xi.jpg
[2023-07-12 12:41:00,062 - bdfr.downloader - DEBUG] - Hash added to master list: 87de1997c902759c325df051b65b513f
[2023-07-12 12:41:00,062 - bdfr.downloader - INFO] - Downloaded submission 14xq8xi from traps
[2023-07-12 12:41:00,062 - bdfr.downloader - DEBUG] - Attempting to download submission 14xtvfs
[2023-07-12 12:41:00,062 - bdfr.downloader - DEBUG] - Using Direct with url https://i.redd.it/7lcm1vzkckbb1.jpg
[2023-07-12 12:41:00,282 - bdfr.downloader - DEBUG] - Written file to /tmp/traps/petertheeater15_Any success with this style of trap?_14xtvfs.jpg
[2023-07-12 12:41:00,282 - bdfr.downloader - DEBUG] - Hash added to master list: 10f99fefbc27a3e2406566c1c4e4f871
[2023-07-12 12:41:00,282 - bdfr.downloader - INFO] - Downloaded submission 14xtvfs from traps
[2023-07-12 12:41:00,282 - bdfr.downloader - DEBUG] - Attempting to download submission 14x0ixv
[2023-07-12 12:41:00,282 - bdfr.downloader - DEBUG] - Using Direct with url https://i.redd.it/esesmda3ydbb1.jpg
[2023-07-12 12:41:00,573 - bdfr.downloader - DEBUG] - Written file to /tmp/traps/Complexikitty_what would you do if you woke up next to me? 🥺_14x0ixv.jpg
[2023-07-12 12:41:00,573 - bdfr.downloader - DEBUG] - Hash added to master list: 42c3629bec53a9c76537c7247b45f831
[2023-07-12 12:41:00,573 - bdfr.downloader - INFO] - Downloaded submission 14x0ixv from traps
[2023-07-12 12:41:00,573 - bdfr.downloader - DEBUG] - Attempting to download submission 14xrjvy
[2023-07-12 12:41:00,573 - bdfr.downloader - DEBUG] - Using Direct with url https://i.redd.it/nugjgh3ixjbb1.jpg
[2023-07-12 12:41:00,772 - bdfr.downloader - DEBUG] - Written file to /tmp/traps/IndieeeChic_Spread your legs baby, mommy’s gonna fuck you😈_14xrjvy.jpg
[2023-07-12 12:41:00,772 - bdfr.downloader - DEBUG] - Hash added to master list: a5e6cd9a7e6030cb860636d9393345e3
[2023-07-12 12:41:00,772 - bdfr.downloader - INFO] - Downloaded submission 14xrjvy from traps
[2023-07-12 12:41:00,772 - bdfr.downloader - DEBUG] - Attempting to download submission 14xogty
[2023-07-12 12:41:00,772 - bdfr.downloader - DEBUG] - Using Direct with url https://i.redd.it/to1kcgl0cjbb1.jpg
[2023-07-12 12:41:01,035 - bdfr.downloader - DEBUG] - Written file to /tmp/traps/misstyn_Would we take turns fucking each other if you find me in your room like that?_14xogty.jpg
[2023-07-12 12:41:01,035 - bdfr.downloader - DEBUG] - Hash added to master list: 80c2c7703f5c9ec1f342384c612d79d0
[2023-07-12 12:41:01,035 - bdfr.downloader - INFO] - Downloaded submission 14xogty from traps
[2023-07-12 12:41:01,035 - bdfr.downloader - DEBUG] - Attempting to download submission 14xsi5i
[2023-07-12 12:41:01,035 - bdfr.downloader - DEBUG] - Using Direct with url https://i.redd.it/bu10q6wwyjbb1.gif
[2023-07-12 12:41:02,803 - bdfr.downloader - DEBUG] - Written file to /tmp/traps/frycl2014_Question… are you the cock or the ass here?_14xsi5i.gif
[2023-07-12 12:41:02,803 - bdfr.downloader - DEBUG] - Hash added to master list: 79d769ae700acd4b94f8d878e00cbaa2
[2023-07-12 12:41:02,803 - bdfr.downloader - INFO] - Downloaded submission 14xsi5i from traps
[2023-07-12 12:41:02,803 - bdfr.downloader - DEBUG] - Attempting to download submission 14xraas
[2023-07-12 12:41:02,803 - bdfr.downloader - DEBUG] - Using Direct with url https://i.redd.it/wzzd30apvjbb1.jpg
[2023-07-12 12:41:03,090 - bdfr.downloader - DEBUG] - Written file to /tmp/traps/Edgedancer_822_This is what hides under my skirt_14xraas.jpg
[2023-07-12 12:41:03,091 - bdfr.downloader - DEBUG] - Hash added to master list: d9d4780104ec800c00a810187ea55280
[2023-07-12 12:41:03,091 - bdfr.downloader - INFO] - Downloaded submission 14xraas from traps
[2023-07-12 12:41:03,091 - bdfr.downloader - DEBUG] - Attempting to download submission 14xule7
[2023-07-12 12:41:03,091 - bdfr.downloader - DEBUG] - Using Direct with url https://i.redd.it/qfwpjynsgkbb1.jpg
[2023-07-12 12:41:03,423 - bdfr.downloader - DEBUG] - Written file to /tmp/traps/MamaMephistopheles_POV: the succubus is about to fuck out your soul 😈_14xule7.jpg
[2023-07-12 12:41:03,423 - bdfr.downloader - DEBUG] - Hash added to master list: fed3b611b7d40f807bc04f5b5a78b128
[2023-07-12 12:41:03,423 - bdfr.downloader - INFO] - Downloaded submission 14xule7 from traps
[2023-07-12 12:41:03,423 - bdfr.downloader - DEBUG] - Attempting to download submission 14xsycz
[2023-07-12 12:41:03,424 - bdfr.downloader - DEBUG] - Using Redgifs with url https://www.redgifs.com/watch/warlikeenormoushairstreak
[2023-07-12 12:41:04,259 - bdfr.downloader - DEBUG] - Written file to /tmp/traps/Kirliaaa_Would you fuck me if we woke up together? 😳💕_14xsycz.mp4
[2023-07-12 12:41:04,259 - bdfr.downloader - DEBUG] - Hash added to master list: 94dd17057e1d72af0585b5a051dd9ea7
[2023-07-12 12:41:04,259 - bdfr.downloader - INFO] - Downloaded submission 14xsycz from traps
[2023-07-12 12:41:04,259 - bdfr.downloader - DEBUG] - Attempting to download submission 14xsu7z
[2023-07-12 12:41:04,260 - bdfr.downloader - DEBUG] - Using Redgifs with url https://www.redgifs.com/watch/deadlyvapidiberianmidwifetoad
[2023-07-12 12:41:05,193 - bdfr.downloader - DEBUG] - Written file to /tmp/traps/KinseySaintClair_Would you be the chair? 🥺👉🏼👈🏼_14xsu7z.mp4
[2023-07-12 12:41:05,193 - bdfr.downloader - DEBUG] - Hash added to master list: eb2c4dc9009e3e048623670f9d8ec7dd
[2023-07-12 12:41:05,193 - bdfr.downloader - INFO] - Downloaded submission 14xsu7z from traps
[2023-07-12 12:41:05,193 - bdfr.downloader - DEBUG] - Attempting to download submission 14xpmj8
[2023-07-12 12:41:05,193 - bdfr.downloader - DEBUG] - Using Direct with url https://i.redd.it/z8u4ikndkjbb1.gif
[2023-07-12 12:41:05,844 - bdfr.downloader - DEBUG] - Written file to /tmp/traps/MunizBabi69_If I let you suck my Girlcock would you bump up my grade, professor?_14xpmj8.gif
[2023-07-12 12:41:05,844 - bdfr.downloader - DEBUG] - Hash added to master list: 179abd537ffde6110249a4a44daaf6f6
[2023-07-12 12:41:05,844 - bdfr.downloader - INFO] - Downloaded submission 14xpmj8 from traps
[2023-07-12 12:41:05,844 - bdfr.downloader - DEBUG] - Attempting to download submission 14wsh5j
[2023-07-12 12:41:05,844 - bdfr.downloader - DEBUG] - Using Direct with url https://i.redd.it/crlxlujofcbb1.jpg
[2023-07-12 12:41:06,088 - bdfr.downloader - DEBUG] - Written file to /tmp/traps/xroxywolfx_Do you think it would fit 😳?_14wsh5j.jpg
[2023-07-12 12:41:06,088 - bdfr.downloader - DEBUG] - Hash added to master list: c5da9acb8f2b5c86f2856d22beebf6e0
[2023-07-12 12:41:06,088 - bdfr.downloader - INFO] - Downloaded submission 14wsh5j from traps
[2023-07-12 12:41:06,088 - bdfr.downloader - DEBUG] - Attempting to download submission 14xsmyx
[2023-07-12 12:41:06,088 - bdfr.downloader - DEBUG] - Using Direct with url https://i.redd.it/5zsmzhkk4kbb1.jpg
[2023-07-12 12:41:06,352 - bdfr.downloader - DEBUG] - Written file to /tmp/traps/pebblysx_Sucking or fucking, which first?_14xsmyx.jpg
[2023-07-12 12:41:06,352 - bdfr.downloader - DEBUG] - Hash added to master list: add1f3c4630e9d45e9dd3d189175b619
[2023-07-12 12:41:06,352 - bdfr.downloader - INFO] - Downloaded submission 14xsmyx from traps
[2023-07-12 12:41:06,352 - bdfr.downloader - DEBUG] - Attempting to download submission 14xli1z
[2023-07-12 12:41:06,352 - bdfr.downloader - DEBUG] - Using Direct with url https://i.redd.it/07muax4loibb1.gif
[2023-07-12 12:41:07,897 - bdfr.downloader - DEBUG] - Written file to /tmp/traps/alliecheeks_Do you like rock hard cocks?_14xli1z.gif
[2023-07-12 12:41:07,897 - bdfr.downloader - DEBUG] - Hash added to master list: 0557c16c9a5fdeffc7a25e42204ab6ad
[2023-07-12 12:41:07,897 - bdfr.downloader - INFO] - Downloaded submission 14xli1z from traps
[2023-07-12 12:41:07,897 - bdfr.downloader - DEBUG] - Attempting to download submission 14x7a1w
[2023-07-12 12:41:07,897 - bdfr.downloader - DEBUG] - Using Direct with url https://i.redd.it/h9pxltjw7fbb1.gif
[2023-07-12 12:41:08,733 - bdfr.downloader - DEBUG] - Written file to /tmp/traps/tsfoxyanastasia_I have a surprise for you after we get home from our date.._14x7a1w.gif
[2023-07-12 12:41:08,733 - bdfr.downloader - DEBUG] - Hash added to master list: 182e2b97339292c2b95757f713fd115a
[2023-07-12 12:41:08,733 - bdfr.downloader - INFO] - Downloaded submission 14x7a1w from traps
[2023-07-12 12:41:08,734 - bdfr.downloader - DEBUG] - Attempting to download submission 14xs679
[2023-07-12 12:41:08,734 - bdfr.downloader - DEBUG] - Using Redgifs with url https://www.redgifs.com/watch/acrobaticleftarmednylonshrimp
[2023-07-12 12:41:09,469 - bdfr.downloader - DEBUG] - Written file to /tmp/traps/majinkunbuu_Happy Humpday_14xs679.mp4
[2023-07-12 12:41:09,470 - bdfr.downloader - DEBUG] - Hash added to master list: 1a405ab5a273b80598f6080aa01bd1e3
[2023-07-12 12:41:09,470 - bdfr.downloader - INFO] - Downloaded submission 14xs679 from traps
[2023-07-12 12:41:09,470 - bdfr.downloader - DEBUG] - Attempting to download submission 14xpv3c
[2023-07-12 12:41:09,470 - bdfr.downloader - DEBUG] - Using Direct with url https://i.redd.it/5nbqep43mjbb1.jpg
[2023-07-12 12:41:09,710 - bdfr.downloader - DEBUG] - Written file to /tmp/traps/JacquelineJasper_Harley has a surprise for her puddin~_14xpv3c.jpg
[2023-07-12 12:41:09,710 - bdfr.downloader - DEBUG] - Hash added to master list: 050ab93369029bcf0bc4d0537332b3e0
[2023-07-12 12:41:09,710 - bdfr.downloader - INFO] - Downloaded submission 14xpv3c from traps
[2023-07-12 12:41:09,710 - bdfr.downloader - DEBUG] - Attempting to download submission 14xmy6q
[2023-07-12 12:41:09,710 - bdfr.downloader - DEBUG] - Using Redgifs with url https://www.redgifs.com/watch/boldwindingquillback
[2023-07-12 12:41:10,399 - bdfr.downloader - DEBUG] - Written file to /tmp/traps/Knowncow0907_Im always dripping cum hehe_14xmy6q.mp4
[2023-07-12 12:41:10,399 - bdfr.downloader - DEBUG] - Hash added to master list: f5066ce9db4e4c8da70af84b1f336f36
[2023-07-12 12:41:10,399 - bdfr.downloader - INFO] - Downloaded submission 14xmy6q from traps
[2023-07-12 12:41:10,399 - bdfr.downloader - DEBUG] - Attempting to download submission 14xqrb0
[2023-07-12 12:41:10,399 - bdfr.downloader - DEBUG] - Using Redgifs with url https://www.redgifs.com/watch/brownmoralgypsymoth
[2023-07-12 12:41:11,262 - bdfr.downloader - DEBUG] - Written file to /tmp/traps/KikiMiky__I can keep on for hours, trust me_14xqrb0.mp4
[2023-07-12 12:41:11,262 - bdfr.downloader - DEBUG] - Hash added to master list: 65da897d82ea176c61287087045d8d9e
[2023-07-12 12:41:11,262 - bdfr.downloader - INFO] - Downloaded submission 14xqrb0 from traps
[2023-07-12 12:41:11,263 - bdfr.downloader - DEBUG] - Attempting to download submission 14xt18z
[2023-07-12 12:41:11,263 - bdfr.downloader - DEBUG] - Using Direct with url https://i.redd.it/co9upul37kbb1.jpg
[2023-07-12 12:41:11,568 - bdfr.downloader - DEBUG] - Written file to /tmp/traps/sissy_emilyxoxo_Pink to make all of the boys wink! And maybe suck their cocks too!_14xt18z.jpg
[2023-07-12 12:41:11,568 - bdfr.downloader - DEBUG] - Hash added to master list: 58af65a642b7bded1f0cc01054577b96
[2023-07-12 12:41:11,568 - bdfr.downloader - INFO] - Downloaded submission 14xt18z from traps
[2023-07-12 12:41:11,568 - bdfr.downloader - DEBUG] - Attempting to download submission 14xeu2t
[2023-07-12 12:41:11,568 - bdfr.downloader - DEBUG] - Using Direct with url https://i.redd.it/pcqk2q6lxgbb1.jpg
[2023-07-12 12:41:11,861 - bdfr.downloader - DEBUG] - Written file to /tmp/traps/Ariathetransfairy_If we fucked would you rather be the Top? The Bottom? Or Both?😈💕_14xeu2t.jpg
[2023-07-12 12:41:11,861 - bdfr.downloader - DEBUG] - Hash added to master list: 4dce15f6fe46b77616771b84c696c3c0
[2023-07-12 12:41:11,861 - bdfr.downloader - INFO] - Downloaded submission 14xeu2t from traps
[2023-07-12 12:41:11,861 - bdfr.downloader - DEBUG] - Attempting to download submission 14xo8is
[2023-07-12 12:41:11,861 - bdfr.downloader - DEBUG] - Using Redgifs with url https://www.redgifs.com/watch/lostlostkagu
[2023-07-12 12:41:12,693 - bdfr.downloader - DEBUG] - Written file to /tmp/traps/analcurve_My ass is hungry_14xo8is.mp4
[2023-07-12 12:41:12,693 - bdfr.downloader - DEBUG] - Hash added to master list: bad52a1cca817390616ffc15bc770f8d
[2023-07-12 12:41:12,693 - bdfr.downloader - INFO] - Downloaded submission 14xo8is from traps
[2023-07-12 12:41:12,694 - bdfr.downloader - DEBUG] - Attempting to download submission 14xqeya
[2023-07-12 12:41:12,694 - bdfr.downloader - DEBUG] - Using Redgifs with url https://www.redgifs.com/watch/vapidacrobaticsteer
[2023-07-12 12:41:13,662 - bdfr.downloader - DEBUG] - Written file to /tmp/traps/ConfectionLopsided97_Come play with me and my bear 🖤🖤_14xqeya.mp4
[2023-07-12 12:41:13,662 - bdfr.downloader - DEBUG] - Hash added to master list: c09c8f4deef2e265f1a96d1bf26cda3a
[2023-07-12 12:41:13,662 - bdfr.downloader - INFO] - Downloaded submission 14xqeya from traps
[2023-07-12 12:41:13,662 - bdfr.downloader - DEBUG] - Attempting to download submission 14xeq6p
[2023-07-12 12:41:13,662 - bdfr.downloader - DEBUG] - Using Redgifs with url https://www.redgifs.com/watch/spottedmulticoloredumbrette
[2023-07-12 12:41:14,516 - bdfr.downloader - DEBUG] - Written file to /tmp/traps/PuppyGirlX3_Would you rather cum on my toes or in my throat?_14xeq6p.mp4
[2023-07-12 12:41:14,516 - bdfr.downloader - DEBUG] - Hash added to master list: 5d373aa0a24d5246be042903261829a5
[2023-07-12 12:41:14,516 - bdfr.downloader - INFO] - Downloaded submission 14xeq6p from traps
[2023-07-12 12:41:14,517 - bdfr.downloader - DEBUG] - Attempting to download submission 14wsvf5
[2023-07-12 12:41:14,517 - bdfr.downloader - DEBUG] - Using Imgur with url https://i.imgur.com/PYRu2l5.gifv
[2023-07-12 12:41:14,722 - bdfr.downloader - ERROR] - Site Imgur failed to download submission 14wsvf5: Server responded with 404 at https://api.imgur.com/3/image/PYRu2l5
[2023-07-12 12:41:14,723 - bdfr.downloader - DEBUG] - Attempting to download submission 14wrkjm
[2023-07-12 12:41:14,723 - bdfr.downloader - DEBUG] - Using Direct with url https://i.redd.it/va2fchia9cbb1.jpg
[2023-07-12 12:41:14,889 - bdfr.downloader - DEBUG] - Written file to /tmp/traps/TechnoAlways_Nurse ya into a trap?_14wrkjm.jpg
[2023-07-12 12:41:14,889 - bdfr.downloader - DEBUG] - Hash added to master list: 72a028bd935920455d5858ba2da486f8
[2023-07-12 12:41:14,889 - bdfr.downloader - INFO] - Downloaded submission 14wrkjm from traps
[2023-07-12 12:41:14,889 - bdfr.downloader - DEBUG] - Attempting to download submission 14xfuki
[2023-07-12 12:41:14,889 - bdfr.downloader - DEBUG] - Using Redgifs with url https://www.redgifs.com/watch/farflunglightlemur
[2023-07-12 12:41:15,835 - bdfr.downloader - DEBUG] - Written file to /tmp/traps/Adamfurrow_Would you let me throat you while you drive?_14xfuki.mp4
[2023-07-12 12:41:15,836 - bdfr.downloader - DEBUG] - Hash added to master list: 326d2eace74d99e32802c9d0d8713520
[2023-07-12 12:41:15,836 - bdfr.downloader - INFO] - Downloaded submission 14xfuki from traps
[2023-07-12 12:41:15,836 - bdfr.downloader - DEBUG] - Attempting to download submission 14xf725
[2023-07-12 12:41:15,836 - bdfr.downloader - DEBUG] - Using Direct with url https://i.redd.it/ddxv0ge21hbb1.gif
[2023-07-12 12:41:17,290 - bdfr.downloader - DEBUG] - Written file to /tmp/traps/AngelAvaa_prettiest girl dick💕_14xf725.gif
[2023-07-12 12:41:17,290 - bdfr.downloader - DEBUG] - Hash added to master list: 003d1f40d63023a4cb273878b4e788d8
[2023-07-12 12:41:17,290 - bdfr.downloader - INFO] - Downloaded submission 14xf725 from traps
[2023-07-12 12:41:17,399 - bdfr.downloader - ERROR] - The submission after 14xf725 failed to download due to a PRAW exception: received 429 HTTP response
[2023-07-12 12:41:17,399 - bdfr.downloader - DEBUG] - Waiting 60 seconds to continue
[2023-07-12 12:42:17,400 - root - INFO] - Program complete - BDFR Downloader v2.7.0

@gemini0x2
Copy link

I'm dealing with this new error too.

@Root-FTW
Copy link

same error here:

D:\Videos>bdfr download D:\Videos --opts fortnite.yaml
Traceback (most recent call last):
File "C:\Users\rootf\AppData\Local\Programs\Python\Python39\lib\runpy.py", line 197, in _run_module_as_main
return _run_code(code, main_globals, None,
File "C:\Users\rootf\AppData\Local\Programs\Python\Python39\lib\runpy.py", line 87, in run_code
exec(code, run_globals)
File "C:\Users\rootf\AppData\Local\Programs\Python\Python39\Scripts\bdfr.exe_main
.py", line 7, in
File "C:\Users\rootf\AppData\Local\Programs\Python\Python39\lib\site-packages\click\core.py", line 1130, in call
return self.main(*args, **kwargs)
File "C:\Users\rootf\AppData\Local\Programs\Python\Python39\lib\site-packages\click\core.py", line 1055, in main
rv = self.invoke(ctx)
File "C:\Users\rootf\AppData\Local\Programs\Python\Python39\lib\site-packages\click\core.py", line 1657, in invoke
return _process_result(sub_ctx.command.invoke(sub_ctx))
File "C:\Users\rootf\AppData\Local\Programs\Python\Python39\lib\site-packages\click\core.py", line 1404, in invoke
return ctx.invoke(self.callback, **ctx.params)
File "C:\Users\rootf\AppData\Local\Programs\Python\Python39\lib\site-packages\click\core.py", line 760, in invoke
return _callback(*args, **kwargs)
File "C:\Users\rootf\AppData\Local\Programs\Python\Python39\lib\site-packages\click\decorators.py", line 26, in new_func
return f(get_current_context(), *args, **kwargs)
File "C:\Users\rootf\AppData\Local\Programs\Python\Python39\lib\site-packages\bdfr_main
.py", line 117, in cli_download
reddit_downloader = RedditDownloader(config, [stream])
File "C:\Users\rootf\AppData\Local\Programs\Python\Python39\lib\site-packages\bdfr\downloader.py", line 41, in init
super(RedditDownloader, self).init(args, logging_handlers)
File "C:\Users\rootf\AppData\Local\Programs\Python\Python39\lib\site-packages\bdfr\connector.py", line 65, in init self.reddit_lists = self.retrieve_reddit_lists()
File "C:\Users\rootf\AppData\Local\Programs\Python\Python39\lib\site-packages\bdfr\connector.py", line 168, in retrieve_reddit_lists
master_list.extend(self.get_subreddits())
File "C:\Users\rootf\AppData\Local\Programs\Python\Python39\lib\site-packages\bdfr\connector.py", line 276, in get_subreddits
self.check_subreddit_status(reddit)
File "C:\Users\rootf\AppData\Local\Programs\Python\Python39\lib\site-packages\bdfr\connector.py", line 438, in check_subreddit_status
assert subreddit.id
File "C:\Users\rootf\AppData\Local\Programs\Python\Python39\lib\site-packages\praw\models\reddit\base.py", line 35, in getattr
self._fetch()
File "C:\Users\rootf\AppData\Local\Programs\Python\Python39\lib\site-packages\praw\models\reddit\subreddit.py", line 827, in _fetch
data = self._fetch_data()
File "C:\Users\rootf\AppData\Local\Programs\Python\Python39\lib\site-packages\praw\models\reddit\base.py", line 89, in _fetch_data
return self._reddit.request(method="GET", params=params, path=path)
File "C:\Users\rootf\AppData\Local\Programs\Python\Python39\lib\site-packages\praw\util\deprecate_args.py", line 43, in wrapped
return func(**dict(zip(_old_args, args)), **kwargs)
File "C:\Users\rootf\AppData\Local\Programs\Python\Python39\lib\site-packages\praw\reddit.py", line 941, in request
return self._core.request(
File "C:\Users\rootf\AppData\Local\Programs\Python\Python39\lib\site-packages\prawcore\sessions.py", line 330, in request
return self._request_with_retries(
File "C:\Users\rootf\AppData\Local\Programs\Python\Python39\lib\site-packages\prawcore\sessions.py", line 266, in _request_with_retries
raise self.STATUS_EXCEPTIONSresponse.status_code
prawcore.exceptions.TooManyRequests: received 429 HTTP response

@jaxjexjox
Copy link

I run BDFR within a docker container.
I believe it's located here.
https://github.com/overbyrn/docker-bdfr

I have 'fixed' some issues with the docker version, very poorly (as a newbie) by injecting some commands in.

Those commands being:

sudo docker exec bdfr apt-get update -y
sudo docker exec bdfr apt-get upgrade -y
sudo docker exec bdfr apt-get dist-upgrade -y
sudo docker exec bdfr apt install ffmpeg -y

and most importantly, this one:
sudo docker exec bdfr pip install --upgrade praw

Sadly, I am still getting errors.

Traceback (most recent call last): File "/usr/local/lib/python3.9/runpy.py", line 197, in _run_module_as_main return _run_code(code, main_globals, None, File "/usr/local/lib/python3.9/runpy.py", line 87, in _run_code exec(code, run_globals) File "/usr/local/lib/python3.9/site-packages/bdfr/__main__.py", line 160, in <module> cli() File "/usr/local/lib/python3.9/site-packages/click/core.py", line 1130, in __call__ return self.main(*args, **kwargs) File "/usr/local/lib/python3.9/site-packages/click/core.py", line 1055, in main rv = self.invoke(ctx) File "/usr/local/lib/python3.9/site-packages/click/core.py", line 1657, in invoke return _process_result(sub_ctx.command.invoke(sub_ctx)) File "/usr/local/lib/python3.9/site-packages/click/core.py", line 1404, in invoke return ctx.invoke(self.callback, **ctx.params)

To be clear, I get those errors WITH or WITHOUT upgrading praw.

I suspect something has broken.
If I can help more, please let me know. I suspect things may be slightly off, due to me running it from within someone elses custom docker build?

@Serene-Arc
Copy link
Owner

This is because of the new Reddit policy, 429 means 'Too Many Requests', it's the rate limiting error.

@jaxjexjox
Copy link

Well that sounds like we'd need some way to reduce the requests. I'm ok with that too, I can just leave it run overnight.

@drebob24
Copy link

drebob24 commented Jul 14, 2023

The same essentially happens if you try process a bunch of links with JDownloader. Limiting each batch to <100 and spacing them out fixes the problem. Similarly, a bulk download of a subreddit with lots of videos never hit the 429 error compared to one filled with smaller files I assume because the time spent downloading the videos spaced things out enough to not hit the request limit. It looks like with the new API changes bdfr needs to slow down how much it downloads/minute either with a delay between each request or pausing after 90 or so requests with a wait timer before doing the next 90 requests.

@Kudos6505
Copy link

Kudos6505 commented Jul 15, 2023

I am also having this issue, but limiting doesn't help. Even authenticated, I get extremely rate limited, with downloading only a couple text posts (no comments) giving the error.

C:\Users\piguy.DESKTOP-73IAHP5>py -m bdfr download D:\HFY-Stories\NoP\A_Recipe_For_Disaster --user YakiTapioca --submitted --authenticate --file-scheme {TITLE}{REDDITOR}{POSTID}_{DATE} -L 10 -v
[2023-07-14 22:27:38,144 - bdfr.connector - DEBUG] - Loading configuration from C:\Users\piguy.DESKTOP-73IAHP5\AppData\Local\BDFR\bdfr\default_config.cfg
[2023-07-14 22:27:38,147 - bdfr.connector - DEBUG] - Setting maximum download wait time to 120 seconds
[2023-07-14 22:27:38,147 - bdfr.connector - DEBUG] - Setting datetime format string to ISO
[2023-07-14 22:27:38,148 - bdfr.connector - DEBUG] - Disabling the following modules:
[2023-07-14 22:27:38,151 - bdfr.connector - DEBUG] - Using authenticated Reddit instance
Traceback (most recent call last):
File "C:\Users\piguy.DESKTOP-73IAHP5\AppData\Local\Programs\Python\Python310\lib\runpy.py", line 196, in _run_module_as_main
return _run_code(code, main_globals, None,
File "C:\Users\piguy.DESKTOP-73IAHP5\AppData\Local\Programs\Python\Python310\lib\runpy.py", line 86, in run_code
exec(code, run_globals)
File "C:\Users\piguy.DESKTOP-73IAHP5\AppData\Local\Programs\Python\Python310\lib\site-packages\bdfr_main
.py", line 162, in
cli()
File "C:\Users\piguy.DESKTOP-73IAHP5\AppData\Local\Programs\Python\Python310\lib\site-packages\click\core.py", line 1130, in call
return self.main(*args, **kwargs)
File "C:\Users\piguy.DESKTOP-73IAHP5\AppData\Local\Programs\Python\Python310\lib\site-packages\click\core.py", line 1055, in main
rv = self.invoke(ctx)
File "C:\Users\piguy.DESKTOP-73IAHP5\AppData\Local\Programs\Python\Python310\lib\site-packages\click\core.py", line 1657, in invoke
return _process_result(sub_ctx.command.invoke(sub_ctx))
File "C:\Users\piguy.DESKTOP-73IAHP5\AppData\Local\Programs\Python\Python310\lib\site-packages\click\core.py", line 1404, in invoke
return ctx.invoke(self.callback, **ctx.params)
File "C:\Users\piguy.DESKTOP-73IAHP5\AppData\Local\Programs\Python\Python310\lib\site-packages\click\core.py", line 760, in invoke
return _callback(*args, **kwargs)
File "C:\Users\piguy.DESKTOP-73IAHP5\AppData\Local\Programs\Python\Python310\lib\site-packages\click\decorators.py", line 26, in new_func
return f(get_current_context(), *args, **kwargs)
File "C:\Users\piguy.DESKTOP-73IAHP5\AppData\Local\Programs\Python\Python310\lib\site-packages\bdfr_main
.py", line 90, in cli_download
reddit_downloader = RedditDownloader(config)
File "C:\Users\piguy.DESKTOP-73IAHP5\AppData\Local\Programs\Python\Python310\lib\site-packages\bdfr\downloader.py", line 39, in init
super(RedditDownloader, self).init(args)
File "C:\Users\piguy.DESKTOP-73IAHP5\AppData\Local\Programs\Python\Python310\lib\site-packages\bdfr\connector.py", line 59, in init
self.reddit_lists = self.retrieve_reddit_lists()
File "C:\Users\piguy.DESKTOP-73IAHP5\AppData\Local\Programs\Python\Python310\lib\site-packages\bdfr\connector.py", line 160, in retrieve_reddit_lists
master_list.extend(self.get_user_data())
File "C:\Users\piguy.DESKTOP-73IAHP5\AppData\Local\Programs\Python\Python310\lib\site-packages\bdfr\connector.py", line 356, in get_user_data
self.check_user_existence(user)
File "C:\Users\piguy.DESKTOP-73IAHP5\AppData\Local\Programs\Python\Python310\lib\site-packages\bdfr\connector.py", line 383, in check_user_existence
if user.id:
File "C:\Users\piguy.DESKTOP-73IAHP5\AppData\Local\Programs\Python\Python310\lib\site-packages\praw\models\reddit\base.py", line 35, in getattr
self._fetch()
File "C:\Users\piguy.DESKTOP-73IAHP5\AppData\Local\Programs\Python\Python310\lib\site-packages\praw\models\reddit\redditor.py", line 179, in _fetch
data = self._fetch_data()
File "C:\Users\piguy.DESKTOP-73IAHP5\AppData\Local\Programs\Python\Python310\lib\site-packages\praw\models\reddit\base.py", line 89, in _fetch_data
return self._reddit.request(method="GET", params=params, path=path)
File "C:\Users\piguy.DESKTOP-73IAHP5\AppData\Local\Programs\Python\Python310\lib\site-packages\praw\util\deprecate_args.py", line 43, in wrapped
return func(**dict(zip(_old_args, args)), **kwargs)
File "C:\Users\piguy.DESKTOP-73IAHP5\AppData\Local\Programs\Python\Python310\lib\site-packages\praw\reddit.py", line 941, in request
return self._core.request(
File "C:\Users\piguy.DESKTOP-73IAHP5\AppData\Local\Programs\Python\Python310\lib\site-packages\prawcore\sessions.py", line 330, in request
return self._request_with_retries(
File "C:\Users\piguy.DESKTOP-73IAHP5\AppData\Local\Programs\Python\Python310\lib\site-packages\prawcore\sessions.py", line 266, in _request_with_retries
raise self.STATUS_EXCEPTIONSresponse.status_code
prawcore.exceptions.TooManyRequests: received 429 HTTP response

I did do a massive archive in the past, but it has been several days with no downloads since. I have tried waiting hours between downloads of 10 posts, but it always fails at least once, usually at the first post. I can load posts on my account and computer fine, but this application has lots of trouble.

Would changing User agent or API access work? Providing an option to add time between post downloads could also help, but I don't know how extreme it would have to be.

@Serene-Arc
Copy link
Owner

Serene-Arc commented Jul 15, 2023

Yes, I'm going to work on this on my tomorrow. Basically Reddit has instituted rate limits that are per app. That means that while you're using the provided client ID and secret, every single user of the BDFR has a combined quota. All of you using it are making it extremely hard for anyone to use it at all.

I'll be working on a message that displays when this happens but you can change the client ID on your own. The configuration file has that. If you register your own application with Reddit, the BDFR will work much better, though there will still be quotas on your number of requests. I'll be adding logic to wait for the reset and handle these errors better and tightening up the number of requests where I can but, for now, registering your own application would be best.

@Kudos6505
Copy link

This is the same problem Apollo and other 3rd party apps are having, right? Do we use "https://old.reddit.com/prefs/apps/" or "https://support.reddithelp.com/hc/en-us/requests/new?ticket_form_id=14868593862164" to register an app?

Also, thank you for working on this. With how bad reddit is shutting down access, I am glad people are still helping others get data out.

@markl181
Copy link

markl181 commented Jul 15, 2023

You'll need to go to https://old.reddit.com/prefs/apps/ - I used a localhost URL for the about and redirect, and selected web app. Then go to the default_config.cfg file, which for me is in c:\users[username]\appdata\local\bdfr\bdfr, and replace the id, which is at the top of the app page in reddit under the name, and the secret, which is visible when you create the app.

@Written2001
Copy link

@markl181 which exact URL did you use for the redirect and about?
I've tried http://localhost, registered a web app, changed the id and the secret in the defaults_config.cfg but without success. The logs still state [2023-07-15 13:06:15,092 - bdfr.connector - DEBUG] - Using unauthenticated Reddit instance. Followed by the error above.

@Serene-Arc
Copy link
Owner

Serene-Arc commented Jul 15, 2023

The BDFR can do the registration itself. You just need to get the client ID and secret here and then put that into the configuration file.

For the website, set http://localhost:7634/ as the URL, that's what the BDFR will return to. The implementation is in bdfr/oauth2.py.

@Written2001
Copy link

Thanks a lot it works now!
I just mixed up the --config and --opts path and wasn't setting the correct config file.

@samawss
Copy link

samawss commented Jul 15, 2023

Thanks a lot it works now! I just mixed up the --config and --opts path and wasn't setting the correct config file.

Can you tell the exact command you used thats working now? I am getting same error

@jaxjexjox
Copy link

Yes, I'm going to work on this on my tomorrow. Basically Reddit has instituted rate limits that are per app. That means that while you're using the provided client ID and secret, every single user of the BDFR has a combined quota. All of you using it are making it extremely hard for anyone to use it at all.

I'll be working on a message that displays when this happens but you can change the client ID on your own. The configuration file has that. If you register your own application with Reddit, the BDFR will work much better, though there will still be quotas on your number of requests. I'll be adding logic to wait for the reset and handle these errors better and tightening up the number of requests where I can but, for now, registering your own application would be best.

This effort is very much appreciated, honestly I expected with all this work you might just drop it.
It's much appreciated.

@Serene-Arc
Copy link
Owner

Hopefully it won't be too much work, but due to the way the repository is set up, it'll limit when I can make a new master release. I don't have the power to change the secrets we use for tests, nor do I have the power to override a merge block into master because of said tests. I'll fix the problem and then see if I can get Ali to change it over.

I did bring up moving the repository to an organisational account, but that's its own set of problems, not least that it would effectively create a new repository that this one would have to link to, so it's not an immediate fix anyway.

@Serene-Arc
Copy link
Owner

So...fixing this will take a fair bit of work. The way PRAW works is that it uses lazy variables. That means any time that the code calls a variable, it could potentially call Reddit. Any call could then return a 429 error and, of course, PRAW doesn't offer any way to deal with this.

I'll have to go through all of the core code and refactor it into more atomic parts. Then I'll have to wrap all of them in code to make it wait and not lose too much work so...hopefully it won't take too long.

@nascentt
Copy link

nascentt commented Jul 16, 2023

many thanks everyone. I condensed the steps for anyone like me having issues:

  • go to https://old.reddit.com/prefs/apps/

  • I already had Bulk Downloader For Reddit - but I understand that one uses a shared client id so I created a new key at the bottom of the page.

  • name: bdfr

  • web app

  • description: bdfr

  • about url: http://localhost:7634

  • redirect url: http://localhost:7634

  • run
    notepad %LOCALAPPDATA%\bdfr\bdfr\default_config.cfg

  • copy the secret from the webpage to the cfg file to client_secret

  • and the client id which is displayed under web app on the web page and next to the icon to client_id in the cfg file

  • then ensure you use --authenticate with your bdfr download commands

@GarethFreeman
Copy link
Author

many thanks everyone. I condensed the steps for anyone like me having issues:

* go to https://old.reddit.com/prefs/apps/

* I already had Bulk Downloader For Reddit - but I understand that one uses a shared client id so I created a new key at the bottom of the page.

* name: bdfr

* web app

* description: bdfr

* about url: http://localhost:7634/

* redirect url: http://localhost:7634/

* run
  notepad %LOCALAPPDATA%\bdfr\bdfr\default_config.cfg

* copy the secret from the webpage to the cfg file to client_secret

* and the client id which is displayed under web app on the web page and next to the icon to client_id in the cfg file

* then ensure you use --authenticate with your bdfr download commands

This still isn't working for me. I get this response in cmd:
py -3 -m bdfr download C:\bdfrips\dft --user diffecit --submitted --authenticate
[2023-07-16 19:03:40,782 - bdfr.oauth2 - WARNING] - Authentication action required before the program can proceed
[2023-07-16 19:03:40,782 - bdfr.oauth2 - WARNING] - Authenticate at https://www.reddit.com/api/v1/authorize?client_id=9aSFgyzrSacy4WqMzFqjCw&duration=permanent&redirect_uri=http%3A%2F%2Flocalhost%3A7634&response_type=code&scope=identity+save+read+history&state=6888

The link on reddit then says:

bad request (reddit.com)

you sent an invalid request
— invalid redirect_uri parameter.

I have done everything in your post correctly. What's the problem?

@gemini0x2
Copy link

gemini0x2 commented Jul 16, 2023

For those having problems with using their own client_id and client_secret. This is what I did.

How to use bdfr with your own client_id and client_secret (Easy):

  1. Go to https://old.reddit.com/prefs/apps and click on create an app...
  2. Fill out the form then click on create app
Screen Shot 2023-07-16 at 2 18 03 PM 3. Take note of your `client_id` and `client_secret` Screen Shot 2023-07-16 at 2 22 48 PM 4. Create a txt file and copy the following into the file.
[DEFAULT]
client_id = 12345
client_secret = 12345
scopes = identity, history, read, save, mysubreddits
backup_log_count = 3
max_wait_time = 120
time_format = ISO
  1. Replace the client_id and client_secret values with your own values. Save and rename the file to my_config.cfg

  2. When running bdfr make sure you run it with the --config flag to use your my_config.cfg . For example.
    bdfr download ./path/to/output --user user --submitted --config ./path/to/my_config.cfg

@Loriden
Copy link

Loriden commented Jul 17, 2023

many thanks everyone. I condensed the steps for anyone like me having issues:

* go to https://old.reddit.com/prefs/apps/

* I already had Bulk Downloader For Reddit - but I understand that one uses a shared client id so I created a new key at the bottom of the page.

* name: bdfr

* web app

* description: bdfr

* about url: http://localhost:7634/

* redirect url: http://localhost:7634/

* run
  notepad %LOCALAPPDATA%\bdfr\bdfr\default_config.cfg

* copy the secret from the webpage to the cfg file to client_secret

* and the client id which is displayed under web app on the web page and next to the icon to client_id in the cfg file

* then ensure you use --authenticate with your bdfr download commands

This still isn't working for me. I get this response in cmd: py -3 -m bdfr download C:\bdfrips\dft --user diffecit --submitted --authenticate [2023-07-16 19:03:40,782 - bdfr.oauth2 - WARNING] - Authentication action required before the program can proceed [2023-07-16 19:03:40,782 - bdfr.oauth2 - WARNING] - Authenticate at https://www.reddit.com/api/v1/authorize?client_id=9aSFgyzrSacy4WqMzFqjCw&duration=permanent&redirect_uri=http%3A%2F%2Flocalhost%3A7634&response_type=code&scope=identity+save+read+history&state=6888

The link on reddit then says:

bad request (reddit.com)

you sent an invalid request — invalid redirect_uri parameter.

I have done everything in your post correctly. What's the problem?

Remove the trailing '/' in the redirect URI section of the reddiu web app - see the screenshots above from @Gavriik and note that they is no slash at the end of the redirect and about URIs

@M-Paulsen
Copy link

I get the error below during the authentication part.

The auth part seems to work just fine on the reddit side, it's just gives this error 500 on the return.

I am running bdfr on a separate server and doing the auth on my desktop. I've done the same previously with other programs that use reddit api without issue though.

[2023-07-17 16:26:00,363 - bdfr.oauth2 - WARNING] - Authentication action required before the program can proceed
[2023-07-17 16:26:00,363 - bdfr.oauth2 - WARNING] - Authenticate at https://www.reddit.com/api/v1/authorize?client_id=qo2gctMzJ0jUDULB2o97FQ&duration=permanent&redirect_uri=http%3A%2F%2Flocalhost%3A7634&response_type=code&scope=history+identity+read+mysubreddits+save&state=38960
Traceback (most recent call last):
File "/usr/lib/python3.10/runpy.py", line 196, in _run_module_as_main
return _run_code(code, main_globals, None,
File "/usr/lib/python3.10/runpy.py", line 86, in _run_code
exec(code, run_globals)
File "/home/user1/.local/lib/python3.10/site-packages/bdfr/main.py", line 222, in
cli()
File "/usr/lib/python3/dist-packages/click/core.py", line 1128, in call
return self.main(*args, **kwargs)
File "/usr/lib/python3/dist-packages/click/core.py", line 1053, in main
rv = self.invoke(ctx)
File "/usr/lib/python3/dist-packages/click/core.py", line 1659, in invoke
return _process_result(sub_ctx.command.invoke(sub_ctx))
File "/usr/lib/python3/dist-packages/click/core.py", line 1395, in invoke
return ctx.invoke(self.callback, **ctx.params)
File "/usr/lib/python3/dist-packages/click/core.py", line 754, in invoke
return __callback(*args, **kwargs)
File "/usr/lib/python3/dist-packages/click/decorators.py", line 26, in new_func
return f(get_current_context(), *args, **kwargs)
File "/home/user1/.local/lib/python3.10/site-packages/bdfr/main.py", line 117, in cli_download
reddit_downloader = RedditDownloader(config, [stream])
File "/home/user1/.local/lib/python3.10/site-packages/bdfr/downloader.py", line 41, in init
super(RedditDownloader, self).init(args, logging_handlers)
File "/home/user1/.local/lib/python3.10/site-packages/bdfr/connector.py", line 63, in init
self._setup_internal_objects()
File "/home/user1/.local/lib/python3.10/site-packages/bdfr/connector.py", line 80, in _setup_internal_objects
self.create_reddit_instance()
File "/home/user1/.local/lib/python3.10/site-packages/bdfr/connector.py", line 144, in create_reddit_instance
token = oauth2_authenticator.retrieve_new_token()
File "/home/user1/.local/lib/python3.10/site-packages/bdfr/oauth2.py", line 67, in retrieve_new_token
refresh_token = reddit.auth.authorize(params["code"])
File "/home/user1/.local/lib/python3.10/site-packages/praw/models/auth.py", line 54, in authorize
authorizer.authorize(code)
File "/home/user1/.local/lib/python3.10/site-packages/prawcore/auth.py", line 242, in authorize
self._request_token(
File "/home/user1/.local/lib/python3.10/site-packages/prawcore/auth.py", line 155, in _request_token
response = self._authenticator._post(url, **data)
File "/home/user1/.local/lib/python3.10/site-packages/prawcore/auth.py", line 38, in _post
raise ResponseException(response)
prawcore.exceptions.ResponseException: received 500 HTTP response

@slitchampion
Copy link

I'm still getting 429s pretty quickly after setting that up and using --authenticate.

@jameswebb07
Copy link

I'm still getting 429s pretty quickly after setting that up and using --authenticate.

follow this : #910 (comment)

@ErikLentz
Copy link

Today I was getting 429s. Then I logged into Reddit in a browser (on a different PC, but same public IP) and the 429s stopped. Think this is intended by Reddit?

@Root-FTW
Copy link

Definitely, reddit is limiting the rate of request. But if you use your own client_id and client_secret you should be good. Not sure why some people still get 429s.

Maybe they did not follow your instructions correctly, or they are not getting the my_config.cfg file correctly when running the script.

In my case the error 429 stopped appearing with your fix, so I confirm that your fix works perfect :D

I only get errors when the script encounters a twitter or youtube post I always get an error and it never downloads those videos, but I think that has always happened to me.

@ErikLentz
Copy link

I get the error below during the authentication part.

The auth part seems to work just fine on the reddit side, it's just gives this error 500 on the return.

I am running bdfr on a separate server and doing the auth on my desktop. I've done the same previously with other programs that use reddit api without issue though.

I'm seeing the same thing. Stuck here

@markl181
Copy link

This did fix the 429 error for me, but I was still running into the endless hang issues reported in #911 (now closed which is why I'm commenting here). Ended up just giving up on what I was doing but just in case it helps anyone else.

@Root-FTW
Copy link

Definitely, reddit is limiting the rate of request. But if you use your own client_id and client_secret you should be good. Not sure why some people still get 429s.

Before the fix with the swcript I was getting approximately 100 videos (I run the script every 24 hours), with your fix I am getting only 20 videos or less, is there something in the custom .cfg file that can cause this?

@gemini0x2
Copy link

gemini0x2 commented Jul 25, 2023

Before the fix with the swcript I was getting approximately 100 videos (I run the script every 24 hours), with your fix I am getting only 20 videos or less, is there something in the custom .cfg file that can cause this?

I don't think the issue is related to the custom .cfg, as the only thing that changes from the default .cfg used by bdfr is the client_id and client_secret. Apart from that everything else remains the same.

@WARl0-01
Copy link

for those who still see issues with BDFR after making an app in prefs

  • Try making a folder called 'configfiles' or something with no spaces in your localdisk folder
  • specify the path by adding --config (letter):(foldername)(file name).cfg to your bdfr command
  • also consider uninstalling and re-installing bdfr
    I both re-installed bdfr and used the no space folder before trying again so I can't attribute the fix to a specific one. I only write this because it solved my issues with it not working, versus me putting the config file in the bdfr folder under python foundation

@happysmash27
Copy link

I still get some 429 errors when running as a personal use script (#910 (comment), using --config and a .cfg file in the same directory). Sometimes BDFR seems to stall, and whenever I notice that it has done nothing for a few hours, I will close and restart it, and use a small shell script to add back all the URLs with 429 errors back to BDFR to try again. But, some URLs, particularly on /r/AskReddit (probably due to large quantity of comments), seem to always throw 429 errors no matter how many times BDFR goes on them, for example, https://reddit.com/comments/oed06m, which has been ran several times at this point all with failure every single time. Shouldn't BDFR pause before sending the same request again, instead of giving up on the download and moving on to the next one?

@Root-FTW
Copy link

Windows 10:

Comnand used:
bdfr download D:\Videos --opts fortnite.yaml --config my_config.cfg

Result:
image

@Serene-Arc
Copy link
Owner

@Root-FTW that's not the command that you used. The command that you used is ml --config my_config.cfg.

@Root-FTW
Copy link

@Root-FTW that's not the command that you used. The command that you used is ml --config my_config.cfg.

I'm sorry maybe I didn't explain correctly or rather, I didn't put everything in a complete way:

Months ago I created a .bat file which is executed daily in my windows every 24 hours, this is the .bat
image

when I finish running the script is when I get this message:
256398147-ef374fc7-8d5c-4c30-be57-9742fe80da9c

@WARl0-01
Copy link

when I finish running the script is when I get this message

@Root-FTW you don't seem to be specifying the location of the configuration file. I think youve put rhe file into BDFRs working dir but id still specify the path.
I'm not familiar with what "ml" does, but if it's saying it doesn't recognize it, then shouldn't you just remove it?
Again: --config Letter:/path/to/file/filename.cfg

Apologies if this doesn't help

@gemini0x2
Copy link

gemini0x2 commented Jul 27, 2023

when I finish running the script is when I get this message:

Yep, definitely the issue is how you are executing your bdfr command. I'm not familiar with bat scripts, but as @WARl0-01 suggested try passing the absolute path to your .cfg, relative path doesn't seem to work in your case. If that does not solve your problem then mostly like the issue is your command syntax,
you can try bdfr download "D:\Videos" --opts "fornite.yaml" --config "path/my_config.cfg"

@Root-FTW
Copy link

@Gavriik @WARl0-01 Thank you very much, your solution solved my problem perfectly, thank you.

@Serene-Arc
Copy link
Owner

I've pushed changes to the development branch that should hopefully fix this issue. There's an option in praw to extend the timeout. Hopefully that will fix the problem well enough.

@Root-FTW
Copy link

I've pushed changes to the development branch that should hopefully fix this issue. There's an option in praw to extend the timeout. Hopefully that will fix the problem well enough.

hello,

is it possible that this script can download videos only if they last 15 seconds or more?

I can't find a variable for that.

@Serene-Arc
Copy link
Owner

No, that isn't possible.

@Root-FTW
Copy link

No, that isn't possible.

I know this has nothing to do with this project, but it's the best project to get quality content fast and you are the only option I know of that could do something like what I'm looking for.

Is there any chance that this sccript will support tiktok in the future?

I mean I can put for example the hashtag #fortnite and it will bring me the latest videos from tiktok with the hashtag #fortnite, like it does with reddit but with tiktok.

Or if it will never support something like that, do you know of any project that can do that?

@Serene-Arc
Copy link
Owner

No, that isn't something that we can do. The BDFR is for Reddit specifically. It's possible that we could download Tiktok videos that are linked on Reddit but that's it.

Check out yt-dlp. That's what we use for most of the backend video links, they might be able to download specific Tiktok videos.

@Root-FTW
Copy link

No, that isn't something that we can do. The BDFR is for Reddit specifically. It's possible that we could download Tiktok videos that are linked on Reddit but that's it.

Check out yt-dlp. That's what we use for most of the backend video links, they might be able to download specific Tiktok videos.

Thanks for your answer, one last question, is it possible that I don't get this error?

It seems that sometimes it is found with twitter links that contain video like this:
https://twitter.com/FortniteGame/status/1685440259209760768

And I get this error:

image

@gemini0x2
Copy link

Thats simply the logging module doing its job, that part of the code is in bdfr/downloader.py. If you don't want to see that error you can try using the --skip-domain flag in your command.
e.g
bdfr download "D:\Videos" --opts "fornite.yaml" --config "path/my_config.cfg" --skip-domain "twitter.com"

@twentyonerooms87
Copy link

Thanks to all the great comments I am back in business with subreddit downloads using BDFR. Many thanks to all.

Since I am now authenticating, I have not found a way to download posts from users. Does anyone have any tips? Thanks in advance! See below for example when I try to download posts from Limp-Plankton5931

C:\BDFR>c:\users\me\appdata\local\programs\python\python310\python -m bdfr download v:\bdfr\Limp-Plankton5931\ -L 65 --authenticate --config "c:\bdfr\my_config.cfg" --user Limp-Plankton5931 --no-dupes --verbose

[2023-08-14 13:42:13,502 - bdfr.connector - DEBUG] - Setting maximum download wait time to 120 seconds
[2023-08-14 13:42:13,504 - bdfr.connector - DEBUG] - Setting datetime format string to ISO
[2023-08-14 13:42:13,505 - bdfr.connector - DEBUG] - Disabling the following modules:
[2023-08-14 13:42:13,510 - bdfr.connector - DEBUG] - Using authenticated Reddit instance
Version 7.6.1 of praw is outdated. Version 7.7.1 was released Tuesday July 11, 2023.
[2023-08-14 13:42:13,513 - root - INFO] - Program complete

@Serene-Arc
Copy link
Owner

Authentication shouldn't disrupt the process in any way of downloading other users. You need to specify what from them that you want to download, such as using the --submitted flag.

@twentyonerooms87
Copy link

Thanks Serene-Arc! That did the trick!

@Serene-Arc
Copy link
Owner

Hopefully the development has the 429 error fixed, but I won't be able to merge it into master until Ali changes the secrets. I don't have the power to override the master branch protections, so the tests HAVE to be passing before it can be merged. At the moment, The repository secrets have the old client ID which means that the tests take too long and time out. I don't have the power to change that either.

For everyone coming here, pull and use the development branch for the moment and I'll get it merged to master as soon as possible.

@MachiavelliSeraphim
Copy link

Not to sound like an idiot, but ive never pulled from a development branch with pip before.
Is there a command/switch to have pip pull the development branch instead of releases?

@Serene-Arc
Copy link
Owner

You have to specify the link and then pip will handle it. The command that you want is this:

pip install -U git+https://github.com/aliparlakci/bulk-downloader-for-reddit.git@development

For anyone wondering about updates, I've contacted Ali and am waiting for him to respond. Unfortunately this is as much as I can do at the moment.

@MachiavelliSeraphim
Copy link

MachiavelliSeraphim commented Sep 18, 2023

Updated to the development branch and now I get
"[2023-09-18 06:50:22,315 - bdfr.connector - WARNING] - Using an unauthenticated app like this will result in Reddit limiting queries to 10 requests a minute"
for some odd reason....
Config file is manually specified with correct client and secret.
And BDFR seems to be running fine at full speed which is more than 10/minute....

@slitchampion
Copy link

Hopefully the development has the 429 error fixed, but I won't be able to merge it into master until Ali changes the secrets. I don't have the power to override the master branch protections, so the tests HAVE to be passing before it can be merged. At the moment, The repository secrets have the old client ID which means that the tests take too long and time out. I don't have the power to change that either.

For everyone coming here, pull and use the development branch for the moment and I'll get it merged to master as soon as possible.

Any luck getting ahold of Ali?

@Serene-Arc
Copy link
Owner

Not as of yet unfortunately

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests