Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[BUG] doesn't download saved comments #904

Open
1 task done
Zireael07 opened this issue Jul 2, 2023 · 5 comments
Open
1 task done

[BUG] doesn't download saved comments #904

Zireael07 opened this issue Jul 2, 2023 · 5 comments
Assignees
@Serene-Arc
Labels
bug Something isn't working

Comments

@Zireael07
Copy link

Zireael07 commented Jul 2, 2023 •
edited
Loading

  • [ x] I am reporting a bug.
  • [ x] I am running the latest version of BDfR
  • I have read the Opening an issue

Description

I went to download latest saved posts, and noticed it skipped "jfzpldz is not a submission" and by looking at the list of what was just before and after that I figured out it was a single saved comment. Now that I remember, I know I saw similar messages when downloading my entire saved posts history a couple weeks before.... probably were single comments too.

Command

bdfr clone ./clonereddit --user username here --saved --authenticate -L 28

Environment (please complete the following information)

  • OS: Linux Manjaro
  • Python version: [e.g. 3.9.4]

Logs

See comment below
@Zireael07 Zireael07 added the bug Something isn't working label Jul 2, 2023
@Serene-Arc
Copy link
Owner

Logs are NOT OPTIONAL. Please supply them or this issue will be closed.

@Zireael07
Copy link
Author

[2023-07-02 19:08:49,099 - bdfr.connector - DEBUG] - Disabling the following modules:
[2023-07-02 19:08:49,099 - bdfr.connector - Level 9] - Created download filter
[2023-07-02 19:08:49,099 - bdfr.connector - Level 9] - Created time filter
[2023-07-02 19:08:49,099 - bdfr.connector - Level 9] - Created sort filter
[2023-07-02 19:08:49,100 - bdfr.connector - Level 9] - Create file name formatter
[2023-07-02 19:08:49,100 - bdfr.connector - DEBUG] - Using authenticated Reddit instance
[2023-07-02 19:08:49,101 - bdfr.connector - Level 9] - Created site authenticator
[2023-07-02 19:08:49,101 - bdfr.connector - Level 9] - Retrieved subreddits
[2023-07-02 19:08:49,101 - bdfr.connector - Level 9] - Retrieved multireddits
[2023-07-02 19:08:49,101 - bdfr.oauth2 - Level 9] - Loaded OAuth2 token for authoriser
[2023-07-02 19:08:49,532 - bdfr.oauth2 - Level 9] - Written OAuth2 token from authoriser to /home/kasia/.config/bdfr/default_config.cfg
[2023-07-02 19:08:50,000 - bdfr.connector - DEBUG] - Retrieving saved posts of user Zireael07
[2023-07-02 19:08:50,001 - bdfr.connector - Level 9] - Retrieved user data
[2023-07-02 19:08:50,001 - bdfr.connector - Level 9] - Retrieved submissions for given links
[2023-07-02 19:08:50,933 - bdfr.downloader - DEBUG] - Attempting to download submission 14obxuk
[2023-07-02 19:08:50,937 - bdfr.downloader - DEBUG] - Using SelfPost with url https://www.reddit.com/r/dndnext/comments/14obxuk/wizards_seems_to_value_conditions_as_virtual/
[2023-07-02 19:08:51,201 - bdfr.downloader - DEBUG] - Written file to /home/kasia/clonereddit/dndnext/FallenDank_Wizards seems to value conditions as virtual damage when it comes to design_14obxuk.txt
[2023-07-02 19:08:51,202 - bdfr.downloader - DEBUG] - Hash added to master list: d326d8914554075011f0edfdd1b4c8c7
[2023-07-02 19:08:51,202 - bdfr.downloader - INFO] - Downloaded submission 14obxuk from dndnext
[2023-07-02 19:08:51,202 - bdfr.archive_entry.submission_archive_entry - DEBUG] - Retrieving full comment tree for submission 14obxuk
[2023-07-02 19:08:51,872 - bdfr.archiver - DEBUG] - Writing entry 14obxuk to file in JSON format at /home/kasia/clonereddit/dndnext/FallenDank_Wizards seems to value conditions as virtual damage when it comes to design_14obxuk.json
[2023-07-02 19:08:51,872 - bdfr.archiver - INFO] - Record for entry item 14obxuk written to disk
[2023-07-02 19:08:51,872 - bdfr.downloader - DEBUG] - Attempting to download submission 14n8tb5
[2023-07-02 19:08:51,872 - bdfr.downloader - DEBUG] - Using SelfPost with url https://www.reddit.com/r/RPGdesign/comments/14n8tb5/looking_for_help_with_adding_abilities_that/
[2023-07-02 19:08:52,139 - bdfr.downloader - DEBUG] - Written file to /home/kasia/clonereddit/RPGdesign/snowbirdnerd_Looking for help with adding abilities that modify my dice pool mechanic._14n8tb5.txt
[2023-07-02 19:08:52,139 - bdfr.downloader - DEBUG] - Hash added to master list: 1e9993d1b2bb5b7b3864a3dbf781d0b0
[2023-07-02 19:08:52,139 - bdfr.downloader - INFO] - Downloaded submission 14n8tb5 from RPGdesign
[2023-07-02 19:08:52,139 - bdfr.archive_entry.submission_archive_entry - DEBUG] - Retrieving full comment tree for submission 14n8tb5
[2023-07-02 19:08:52,598 - bdfr.archiver - DEBUG] - Writing entry 14n8tb5 to file in JSON format at /home/kasia/clonereddit/RPGdesign/snowbirdnerd_Looking for help with adding abilities that modify my dice pool mechanic._14n8tb5.json
[2023-07-02 19:08:52,598 - bdfr.archiver - INFO] - Record for entry item 14n8tb5 written to disk
[2023-07-02 19:08:52,598 - bdfr.downloader - DEBUG] - Attempting to download submission 14mjemt
[2023-07-02 19:08:52,599 - bdfr.downloader - DEBUG] - Using SelfPost with url https://www.reddit.com/r/rpg/comments/14mjemt/what_are_your_favorite_sub_systems_to_graft_onto/
[2023-07-02 19:08:52,888 - bdfr.downloader - DEBUG] - Written file to /home/kasia/clonereddit/rpg/Additional_Score_275_What are your favorite sub systems to graft onto other systems?_14mjemt.txt
[2023-07-02 19:08:52,888 - bdfr.downloader - DEBUG] - Hash added to master list: 58dbc52c29c72e7f820b6af2473da069
[2023-07-02 19:08:52,889 - bdfr.downloader - INFO] - Downloaded submission 14mjemt from rpg
[2023-07-02 19:08:52,889 - bdfr.archive_entry.submission_archive_entry - DEBUG] - Retrieving full comment tree for submission 14mjemt
[2023-07-02 19:08:53,651 - bdfr.archiver - DEBUG] - Writing entry 14mjemt to file in JSON format at /home/kasia/clonereddit/rpg/Additional_Score_275_What are your favorite sub systems to graft onto other systems?_14mjemt.json
[2023-07-02 19:08:53,652 - bdfr.archiver - INFO] - Record for entry item 14mjemt written to disk
[2023-07-02 19:08:53,652 - bdfr.downloader - DEBUG] - Attempting to download submission 14l8raf
[2023-07-02 19:08:53,652 - bdfr.downloader - DEBUG] - Using Direct with url https://i.redd.it/r2ay00i9ar8b1.png
[2023-07-02 19:08:54,024 - bdfr.downloader - DEBUG] - Written file to /home/kasia/clonereddit/neography/Flacson8528_Mongul, Hangul styled writing system for Mongolian_14l8raf.png
[2023-07-02 19:08:54,025 - bdfr.downloader - DEBUG] - Hash added to master list: 26611ec01b0471ae828ed68eb0ad4ffe
[2023-07-02 19:08:54,025 - bdfr.downloader - INFO] - Downloaded submission 14l8raf from neography
[2023-07-02 19:08:54,026 - bdfr.archive_entry.submission_archive_entry - DEBUG] - Retrieving full comment tree for submission 14l8raf
[2023-07-02 19:08:54,435 - bdfr.archiver - DEBUG] - Writing entry 14l8raf to file in JSON format at /home/kasia/clonereddit/neography/Flacson8528_Mongul, Hangul styled writing system for Mongolian_14l8raf.json
[2023-07-02 19:08:54,437 - bdfr.archiver - INFO] - Record for entry item 14l8raf written to disk
[2023-07-02 19:08:54,437 - bdfr.downloader - DEBUG] - Attempting to download submission 14ky1i6
[2023-07-02 19:08:54,437 - bdfr.downloader - DEBUG] - Using Gallery with url https://www.reddit.com/gallery/14ky1i6
[2023-07-02 19:08:54,816 - bdfr.file_name_formatter - Level 9] - Formatting filename with index 1
[2023-07-02 19:08:54,816 - bdfr.file_name_formatter - Level 9] - Formatting filename with index 2
[2023-07-02 19:08:55,141 - bdfr.downloader - DEBUG] - Written file to /home/kasia/clonereddit/neography/Ryjok_Heknik_Cursive Cuneform_14ky1i6_1.jpg
[2023-07-02 19:08:55,141 - bdfr.downloader - DEBUG] - Hash added to master list: 4a4a70b36e751fa7f066bc37d5f1565c
[2023-07-02 19:08:55,539 - bdfr.downloader - DEBUG] - Written file to /home/kasia/clonereddit/neography/Ryjok_Heknik_Cursive Cuneform_14ky1i6_2.jpg
[2023-07-02 19:08:55,539 - bdfr.downloader - DEBUG] - Hash added to master list: 8d8be87153aec600dcca1c4f5f69bf16
[2023-07-02 19:08:55,539 - bdfr.downloader - INFO] - Downloaded submission 14ky1i6 from neography
[2023-07-02 19:08:55,539 - bdfr.archive_entry.submission_archive_entry - DEBUG] - Retrieving full comment tree for submission 14ky1i6
[2023-07-02 19:08:55,914 - bdfr.archiver - DEBUG] - Writing entry 14ky1i6 to file in JSON format at /home/kasia/clonereddit/neography/Ryjok_Heknik_Cursive Cuneform_14ky1i6.json
[2023-07-02 19:08:55,914 - bdfr.archiver - INFO] - Record for entry item 14ky1i6 written to disk
[2023-07-02 19:08:55,914 - bdfr.downloader - DEBUG] - Attempting to download submission 14hu28p
[2023-07-02 19:08:55,914 - bdfr.downloader - DEBUG] - Using SelfPost with url https://www.reddit.com/r/worldbuilding/comments/14hu28p/are_there_any_good_ways_to_make_both_sides_of_a/
[2023-07-02 19:08:56,182 - bdfr.downloader - DEBUG] - Written file to /home/kasia/clonereddit/worldbuilding/Aggressive_Novel1207_Are there any good ways to make both sides of a rebellion justified?_14hu28p.txt
[2023-07-02 19:08:56,182 - bdfr.downloader - DEBUG] - Hash added to master list: a769ed5d879ddd37f4a91fff3c51b262
[2023-07-02 19:08:56,182 - bdfr.downloader - INFO] - Downloaded submission 14hu28p from worldbuilding
[2023-07-02 19:08:56,182 - bdfr.archive_entry.submission_archive_entry - DEBUG] - Retrieving full comment tree for submission 14hu28p
[2023-07-02 19:08:58,550 - bdfr.archiver - DEBUG] - Writing entry 14hu28p to file in JSON format at /home/kasia/clonereddit/worldbuilding/Aggressive_Novel1207_Are there any good ways to make both sides of a rebellion justified?_14hu28p.json
[2023-07-02 19:08:58,551 - bdfr.archiver - INFO] - Record for entry item 14hu28p written to disk
[2023-07-02 19:08:58,551 - bdfr.downloader - DEBUG] - Attempting to download submission 14h8dqf
[2023-07-02 19:08:58,551 - bdfr.downloader - DEBUG] - Using SelfPost with url https://www.reddit.com/r/worldbuilding/comments/14h8dqf/why_are_religions_in_worldbuilding_often_just_a/
[2023-07-02 19:08:58,829 - bdfr.downloader - DEBUG] - Written file to /home/kasia/clonereddit/worldbuilding/Initial_Twist_3138_Why are religions in worldbuilding often just a reskinned Christianity (catholic)?_14h8dqf.txt
[2023-07-02 19:08:58,830 - bdfr.downloader - DEBUG] - Hash added to master list: 2985201fa89977c0b676ab6626c1cee9
[2023-07-02 19:08:58,830 - bdfr.downloader - INFO] - Downloaded submission 14h8dqf from worldbuilding
[2023-07-02 19:08:58,830 - bdfr.archive_entry.submission_archive_entry - DEBUG] - Retrieving full comment tree for submission 14h8dqf
[2023-07-02 19:09:01,791 - bdfr.archiver - DEBUG] - Writing entry 14h8dqf to file in JSON format at /home/kasia/clonereddit/worldbuilding/Initial_Twist_3138_Why are religions in worldbuilding often just a reskinned Christianity (catholic)?_14h8dqf.json
[2023-07-02 19:09:01,792 - bdfr.archiver - INFO] - Record for entry item 14h8dqf written to disk
[2023-07-02 19:09:01,792 - bdfr.downloader - DEBUG] - Attempting to download submission 14ger4e
[2023-07-02 19:09:01,792 - bdfr.downloader - DEBUG] - Using SelfPost with url https://www.reddit.com/r/cyberpunkred/comments/14ger4e/rent_free_players/
[2023-07-02 19:09:02,051 - bdfr.downloader - DEBUG] - Written file to /home/kasia/clonereddit/cyberpunkred/WannabeComicReader_Rent Free players!?!_14ger4e.txt
[2023-07-02 19:09:02,051 - bdfr.downloader - DEBUG] - Hash added to master list: 962d9d89f2b11b542052ba4eae826d88
[2023-07-02 19:09:02,052 - bdfr.downloader - INFO] - Downloaded submission 14ger4e from cyberpunkred
[2023-07-02 19:09:02,052 - bdfr.archive_entry.submission_archive_entry - DEBUG] - Retrieving full comment tree for submission 14ger4e
[2023-07-02 19:09:02,727 - bdfr.archiver - DEBUG] - Writing entry 14ger4e to file in JSON format at /home/kasia/clonereddit/cyberpunkred/WannabeComicReader_Rent Free players!?!_14ger4e.json
[2023-07-02 19:09:02,727 - bdfr.archiver - INFO] - Record for entry item 14ger4e written to disk
[2023-07-02 19:09:02,727 - bdfr.downloader - DEBUG] - Attempting to download submission 14dkoih
[2023-07-02 19:09:02,727 - bdfr.downloader - DEBUG] - Using SelfPost with url https://www.reddit.com/r/RPGdesign/comments/14dkoih/how_to_make_healingfirst_aid_compelling/
[2023-07-02 19:09:02,967 - bdfr.downloader - DEBUG] - Written file to /home/kasia/clonereddit/RPGdesign/ItWasInevitable45_How to make healingfirst aid compelling ?_14dkoih.txt
[2023-07-02 19:09:02,967 - bdfr.downloader - DEBUG] - Hash added to master list: 30c8f4822598a5bfbaaeda42fb5d1e6e
[2023-07-02 19:09:02,968 - bdfr.downloader - INFO] - Downloaded submission 14dkoih from RPGdesign
[2023-07-02 19:09:02,968 - bdfr.archive_entry.submission_archive_entry - DEBUG] - Retrieving full comment tree for submission 14dkoih
[2023-07-02 19:09:03,396 - bdfr.archiver - DEBUG] - Writing entry 14dkoih to file in JSON format at /home/kasia/clonereddit/RPGdesign/ItWasInevitable45_How to make healingfirst aid compelling ?_14dkoih.json
[2023-07-02 19:09:03,396 - bdfr.archiver - INFO] - Record for entry item 14dkoih written to disk
[2023-07-02 19:09:03,397 - bdfr.downloader - DEBUG] - Attempting to download submission 14cwd24
[2023-07-02 19:09:03,397 - bdfr.downloader - DEBUG] - Using SelfPost with url https://www.reddit.com/r/cyberpunkred/comments/14cwd24/cyberpunk_red_podcast/
[2023-07-02 19:09:03,659 - bdfr.downloader - DEBUG] - Written file to /home/kasia/clonereddit/cyberpunkred/MemesByJames_Cyberpunk Red Podcast?_14cwd24.txt
[2023-07-02 19:09:03,659 - bdfr.downloader - DEBUG] - Hash added to master list: bdb35548f1f317c34cbc5cdc3d1ea980
[2023-07-02 19:09:03,659 - bdfr.downloader - INFO] - Downloaded submission 14cwd24 from cyberpunkred
[2023-07-02 19:09:03,659 - bdfr.archive_entry.submission_archive_entry - DEBUG] - Retrieving full comment tree for submission 14cwd24
[2023-07-02 19:09:04,183 - bdfr.archiver - DEBUG] - Writing entry 14cwd24 to file in JSON format at /home/kasia/clonereddit/cyberpunkred/MemesByJames_Cyberpunk Red Podcast?_14cwd24.json
[2023-07-02 19:09:04,183 - bdfr.archiver - INFO] - Record for entry item 14cwd24 written to disk
[2023-07-02 19:09:04,183 - bdfr.downloader - DEBUG] - Attempting to download submission 14cpk3w
[2023-07-02 19:09:04,184 - bdfr.downloader - DEBUG] - Using SelfPost with url https://www.reddit.com/r/IsaacArthur/comments/14cpk3w/how_to_have_ships_docking_with_the_rotating_skin/
[2023-07-02 19:09:04,454 - bdfr.downloader - DEBUG] - Written file to /home/kasia/clonereddit/IsaacArthur/MiamisLastCapitalist_How to have ships docking with the rotating skin of a habitat?_14cpk3w.txt
[2023-07-02 19:09:04,456 - bdfr.downloader - DEBUG] - Hash added to master list: 502a1f8fa1ba6343865bb63c43052764
[2023-07-02 19:09:04,456 - bdfr.downloader - INFO] - Downloaded submission 14cpk3w from IsaacArthur
[2023-07-02 19:09:04,457 - bdfr.archive_entry.submission_archive_entry - DEBUG] - Retrieving full comment tree for submission 14cpk3w
[2023-07-02 19:09:05,261 - bdfr.archiver - DEBUG] - Writing entry 14cpk3w to file in JSON format at /home/kasia/clonereddit/IsaacArthur/MiamisLastCapitalist_How to have ships docking with the rotating skin of a habitat?_14cpk3w.json
[2023-07-02 19:09:05,261 - bdfr.archiver - INFO] - Record for entry item 14cpk3w written to disk
[2023-07-02 19:09:05,261 - bdfr.downloader - DEBUG] - Attempting to download submission 14b10yf
[2023-07-02 19:09:06,348 - bdfr.downloader - ERROR] - Could not download submission 14b10yf: No downloader module exists for url https://www.theverge.com/2023/6/16/23763538/reddit-blackout-api-protest-mod-replacement-threat
[2023-07-02 19:09:06,348 - bdfr.archive_entry.submission_archive_entry - DEBUG] - Retrieving full comment tree for submission 14b10yf
[2023-07-02 19:09:07,165 - bdfr.archiver - DEBUG] - Writing entry 14b10yf to file in JSON format at /home/kasia/clonereddit/RedditAlternatives/ardi62_Here’s the note Reddit sent to moderators threatening them if they don’t reopen_14b10yf.json
[2023-07-02 19:09:07,165 - bdfr.archiver - INFO] - Record for entry item 14b10yf written to disk
[2023-07-02 19:09:07,165 - bdfr.downloader - DEBUG] - Attempting to download submission 149exg5
[2023-07-02 19:09:07,166 - bdfr.downloader - DEBUG] - Using SelfPost with url https://www.reddit.com/r/RPGdesign/comments/149exg5/good_mechanics_to_steal_from_board_games/
[2023-07-02 19:09:07,431 - bdfr.downloader - DEBUG] - Written file to /home/kasia/clonereddit/RPGdesign/TigrisCallidus_Good mechanics to "steal" from Board Games?_149exg5.txt
[2023-07-02 19:09:07,431 - bdfr.downloader - DEBUG] - Hash added to master list: 1ce99917461a4053b2e14ffc5dccd727
[2023-07-02 19:09:07,431 - bdfr.downloader - INFO] - Downloaded submission 149exg5 from RPGdesign
[2023-07-02 19:09:07,431 - bdfr.archive_entry.submission_archive_entry - DEBUG] - Retrieving full comment tree for submission 149exg5
[2023-07-02 19:09:08,270 - bdfr.archiver - DEBUG] - Writing entry 149exg5 to file in JSON format at /home/kasia/clonereddit/RPGdesign/TigrisCallidus_Good mechanics to "steal" from Board Games?_149exg5.json
[2023-07-02 19:09:08,271 - bdfr.archiver - INFO] - Record for entry item 149exg5 written to disk
[2023-07-02 19:09:08,271 - bdfr.downloader - DEBUG] - Attempting to download submission 147x906
[2023-07-02 19:09:10,185 - bdfr.site_downloaders.youtube - ERROR] - �[0;31mERROR:�[0m Unsupported URL: https://news.stanford.edu/2023/06/01/mangroves-value/
Traceback (most recent call last):
File "/home/kasia/.local/lib/python3.10/site-packages/yt_dlp/YoutubeDL.py", line 1518, in wrapper
return func(self, *args, **kwargs)
File "/home/kasia/.local/lib/python3.10/site-packages/yt_dlp/YoutubeDL.py", line 1594, in __extract_info
ie_result = ie.extract(url)
File "/home/kasia/.local/lib/python3.10/site-packages/yt_dlp/extractor/common.py", line 694, in extract
ie_result = self._real_extract(url)
File "/home/kasia/.local/lib/python3.10/site-packages/yt_dlp/extractor/generic.py", line 2510, in _real_extract
raise UnsupportedError(url)
yt_dlp.utils.UnsupportedError: Unsupported URL: https://news.stanford.edu/2023/06/01/mangroves-value/

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "/home/kasia/.local/lib/python3.10/site-packages/bdfr/site_downloaders/youtube.py", line 73, in get_video_data
result = ydl.extract_info(url, download=False)
File "/home/kasia/.local/lib/python3.10/site-packages/yt_dlp/YoutubeDL.py", line 1507, in extract_info
return self.__extract_info(url, self.get_info_extractor(key), download, extra_info, process)
File "/home/kasia/.local/lib/python3.10/site-packages/yt_dlp/YoutubeDL.py", line 1518, in wrapper
return func(self, *args, **kwargs)
File "/home/kasia/.local/lib/python3.10/site-packages/yt_dlp/YoutubeDL.py", line 1615, in __extract_info
return self.process_ie_result(ie_result, download, extra_info)
File "/home/kasia/.local/lib/python3.10/site-packages/yt_dlp/YoutubeDL.py", line 1694, in process_ie_result
return self.extract_info(
File "/home/kasia/.local/lib/python3.10/site-packages/yt_dlp/YoutubeDL.py", line 1507, in extract_info
return self.__extract_info(url, self.get_info_extractor(key), download, extra_info, process)
File "/home/kasia/.local/lib/python3.10/site-packages/yt_dlp/YoutubeDL.py", line 1536, in wrapper
self.report_error(str(e), e.format_traceback())
File "/home/kasia/.local/lib/python3.10/site-packages/yt_dlp/YoutubeDL.py", line 1015, in report_error
self.trouble(f'{self._format_err("ERROR:", self.Styles.ERROR)} {message}', *args, **kwargs)
File "/home/kasia/.local/lib/python3.10/site-packages/yt_dlp/YoutubeDL.py", line 955, in trouble
raise DownloadError(message, exc_info)
yt_dlp.utils.DownloadError: �[0;31mERROR:�[0m Unsupported URL: https://news.stanford.edu/2023/06/01/mangroves-value/
[2023-07-02 19:09:10,190 - bdfr.downloader - ERROR] - Could not download submission 147x906: No downloader module exists for url https://news.stanford.edu/2023/06/01/mangroves-value/
[2023-07-02 19:09:10,190 - bdfr.archive_entry.submission_archive_entry - DEBUG] - Retrieving full comment tree for submission 147x906
[2023-07-02 19:09:10,578 - bdfr.archiver - DEBUG] - Writing entry 147x906 to file in JSON format at /home/kasia/clonereddit/environment/Sariel007_A new approach quantifies the value of mangrove forests in Belize for carbon sequestration, tourism, fisheries, and coastal protection, then uses the values to target conservation and restoration._147x906.json
[2023-07-02 19:09:10,578 - bdfr.archiver - INFO] - Record for entry item 147x906 written to disk
[2023-07-02 19:09:10,579 - bdfr.downloader - DEBUG] - Attempting to download submission 147urul
[2023-07-02 19:09:10,580 - bdfr.downloader - DEBUG] - Using Direct with url https://i.redd.it/07dj4y1cxm5b1.jpg
[2023-07-02 19:09:10,952 - bdfr.downloader - DEBUG] - Written file to /home/kasia/clonereddit/AlternateHistory/Secsidar_What if?: President Hillary R. Clinton._147urul.jpg
[2023-07-02 19:09:10,953 - bdfr.downloader - DEBUG] - Hash added to master list: f3569fc9c8b99b002f65f448e7fa0777
[2023-07-02 19:09:10,953 - bdfr.downloader - INFO] - Downloaded submission 147urul from AlternateHistory
[2023-07-02 19:09:10,953 - bdfr.archive_entry.submission_archive_entry - DEBUG] - Retrieving full comment tree for submission 147urul
[2023-07-02 19:09:13,387 - bdfr.archiver - DEBUG] - Writing entry 147urul to file in JSON format at /home/kasia/clonereddit/AlternateHistory/Secsidar_What if?: President Hillary R. Clinton._147urul.json
[2023-07-02 19:09:13,387 - bdfr.archiver - INFO] - Record for entry item 147urul written to disk
[2023-07-02 19:09:13,387 - bdfr.downloader - WARNING] - jfzpldz is not a submission
[2023-07-02 19:09:14,072 - bdfr.archiver - DEBUG] - Writing entry jfzpldz to file in JSON format at /home/kasia/clonereddit/RPGdesign/Environmental_Fee_64_How does a D100 roll-between mechanic sound for a Fast and Furious style street racing game?jfzpldz.json
[2023-07-02 19:09:14,073 - bdfr.archiver - INFO] - Record for entry item jfzpldz written to disk
[2023-07-02 19:09:14,073 - bdfr.downloader - DEBUG] - Attempting to download submission 115ylc8
[2023-07-02 19:09:14,073 - bdfr.downloader - DEBUG] - Using SelfPost with url https://www.reddit.com/r/RPGdesign/comments/115ylc8/rolling_inbetween_two_numbers/
[2023-07-02 19:09:14,325 - bdfr.downloader - DEBUG] - Written file to /home/kasia/clonereddit/RPGdesign/Winterstorm262_Rolling In-Between Two Numbers_115ylc8.txt
[2023-07-02 19:09:14,325 - bdfr.downloader - DEBUG] - Hash added to master list: 2dd096b2e76075a6fa21f443ee534dc7
[2023-07-02 19:09:14,325 - bdfr.downloader - INFO] - Downloaded submission 115ylc8 from RPGdesign
[2023-07-02 19:09:14,325 - bdfr.archive_entry.submission_archive_entry - DEBUG] - Retrieving full comment tree for submission 115ylc8
[2023-07-02 19:09:14,825 - bdfr.archiver - DEBUG] - Writing entry 115ylc8 to file in JSON format at /home/kasia/clonereddit/RPGdesign/Winterstorm262_Rolling In-Between Two Numbers_115ylc8.json
[2023-07-02 19:09:14,828 - bdfr.archiver - INFO] - Record for entry item 115ylc8 written to disk
[2023-07-02 19:09:14,828 - bdfr.downloader - DEBUG] - Attempting to download submission 145yhhs
[2023-07-02 19:09:14,828 - bdfr.downloader - DEBUG] - Using SelfPost with url https://www.reddit.com/r/RPGdesign/comments/145yhhs/project_v_the_first_draft_of_my_core_resolution/
[2023-07-02 19:09:15,079 - bdfr.downloader - DEBUG] - Written file to /home/kasia/clonereddit/RPGdesign/willneders[Project V] The First Draft of My Core Resolution System. Any thoughts on this?145yhhs.txt
[2023-07-02 19:09:15,079 - bdfr.downloader - DEBUG] - Hash added to master list: 5066948ac8bc6cbfa8ef261c4817adbb
[2023-07-02 19:09:15,079 - bdfr.downloader - INFO] - Downloaded submission 145yhhs from RPGdesign
[2023-07-02 19:09:15,080 - bdfr.archive_entry.submission_archive_entry - DEBUG] - Retrieving full comment tree for submission 145yhhs
[2023-07-02 19:09:15,514 - bdfr.archiver - DEBUG] - Writing entry 145yhhs to file in JSON format at /home/kasia/clonereddit/RPGdesign/willneders[Project V] The First Draft of My Core Resolution System. Any thoughts on this?_145yhhs.json
[2023-07-02 19:09:15,515 - bdfr.archiver - INFO] - Record for entry item 145yhhs written to disk
[2023-07-02 19:09:15,515 - bdfr.downloader - DEBUG] - Attempting to download submission 117f1aa
[2023-07-02 19:09:15,516 - bdfr.downloader - DEBUG] - Using Gallery with url https://www.reddit.com/gallery/117f1aa
[2023-07-02 19:09:16,119 - bdfr.file_name_formatter - Level 9] - Formatting filename with index 1
[2023-07-02 19:09:16,119 - bdfr.file_name_formatter - Level 9] - Formatting filename with index 2
[2023-07-02 19:09:16,318 - bdfr.downloader - DEBUG] - Written file to /home/kasia/clonereddit/neography/omerhicaanu_Standard Modern Cuneiform for my semasiographic conlang_117f1aa_1.jpg
[2023-07-02 19:09:16,318 - bdfr.downloader - DEBUG] - Hash added to master list: 18d66dfcdb3f0a235020f220942f1368
[2023-07-02 19:09:16,683 - bdfr.downloader - DEBUG] - Written file to /home/kasia/clonereddit/neography/omerhicaanu_Standard Modern Cuneiform for my semasiographic conlang_117f1aa_2.jpg
[2023-07-02 19:09:16,684 - bdfr.downloader - DEBUG] - Hash added to master list: fe2d5fa33ff0cd16ca5a053dec9ef3b6
[2023-07-02 19:09:16,684 - bdfr.downloader - INFO] - Downloaded submission 117f1aa from neography
[2023-07-02 19:09:16,684 - bdfr.archive_entry.submission_archive_entry - DEBUG] - Retrieving full comment tree for submission 117f1aa
[2023-07-02 19:09:17,064 - bdfr.archiver - DEBUG] - Writing entry 117f1aa to file in JSON format at /home/kasia/clonereddit/neography/omerhicaanu_Standard Modern Cuneiform for my semasiographic conlang_117f1aa.json
[2023-07-02 19:09:17,065 - bdfr.archiver - INFO] - Record for entry item 117f1aa written to disk
[2023-07-02 19:09:17,065 - bdfr.downloader - DEBUG] - Attempting to download submission 1444yvw
[2023-07-02 19:09:17,065 - bdfr.downloader - DEBUG] - Using SelfPost with url https://www.reddit.com/r/RPGdesign/comments/1444yvw/a_mechanic_for_resisting_your_characters_virtues/
[2023-07-02 19:09:17,383 - bdfr.downloader - DEBUG] - Written file to /home/kasia/clonereddit/RPGdesign/Yumoda_A mechanic for resisting your character’s virtues flaws_1444yvw.txt
[2023-07-02 19:09:17,384 - bdfr.downloader - DEBUG] - Hash added to master list: 38385473870054126a9e62d5f71bfca6
[2023-07-02 19:09:17,384 - bdfr.downloader - INFO] - Downloaded submission 1444yvw from RPGdesign
[2023-07-02 19:09:17,384 - bdfr.archive_entry.submission_archive_entry - DEBUG] - Retrieving full comment tree for submission 1444yvw
[2023-07-02 19:09:18,026 - bdfr.archiver - DEBUG] - Writing entry 1444yvw to file in JSON format at /home/kasia/clonereddit/RPGdesign/Yumoda_A mechanic for resisting your character’s virtues flaws_1444yvw.json
[2023-07-02 19:09:18,026 - bdfr.archiver - INFO] - Record for entry item 1444yvw written to disk
[2023-07-02 19:09:18,026 - bdfr.downloader - DEBUG] - Attempting to download submission 1437tlo
[2023-07-02 19:09:18,026 - bdfr.downloader - DEBUG] - Using Gallery with url https://www.reddit.com/gallery/1437tlo
[2023-07-02 19:09:19,839 - bdfr.file_name_formatter - Level 9] - Formatting filename with index 1
[2023-07-02 19:09:19,840 - bdfr.file_name_formatter - Level 9] - Formatting filename with index 2
[2023-07-02 19:09:19,841 - bdfr.file_name_formatter - Level 9] - Formatting filename with index 3
[2023-07-02 19:09:19,842 - bdfr.file_name_formatter - Level 9] - Formatting filename with index 4
[2023-07-02 19:09:19,842 - bdfr.file_name_formatter - Level 9] - Formatting filename with index 5
[2023-07-02 19:09:20,150 - bdfr.downloader - DEBUG] - Written file to /home/kasia/clonereddit/cyberpunkred/adayat_Inflitrating the Control Center [1st floor, 2nd floor, roof and floorplan] [10x10]_1437tlo_1.jpg
[2023-07-02 19:09:20,150 - bdfr.downloader - DEBUG] - Hash added to master list: 1405981b4ff108ecc374555044fdc6c4
[2023-07-02 19:09:20,454 - bdfr.downloader - DEBUG] - Written file to /home/kasia/clonereddit/cyberpunkred/adayat_Inflitrating the Control Center [1st floor, 2nd floor, roof and floorplan] [10x10]_1437tlo_2.jpg
[2023-07-02 19:09:20,454 - bdfr.downloader - DEBUG] - Hash added to master list: 5ec7f7c0ac31a6e442b4c8c16157bde3
[2023-07-02 19:09:20,774 - bdfr.downloader - DEBUG] - Written file to /home/kasia/clonereddit/cyberpunkred/adayat_Inflitrating the Control Center [1st floor, 2nd floor, roof and floorplan] [10x10]_1437tlo_3.jpg
[2023-07-02 19:09:20,775 - bdfr.downloader - DEBUG] - Hash added to master list: 702e162ecea19a3ab5c6d5092e015217
[2023-07-02 19:09:22,358 - bdfr.downloader - DEBUG] - Written file to /home/kasia/clonereddit/cyberpunkred/adayat_Inflitrating the Control Center [1st floor, 2nd floor, roof and floorplan] [10x10]_1437tlo_4.jpg
[2023-07-02 19:09:22,358 - bdfr.downloader - DEBUG] - Hash added to master list: f93bc02dbfecb7a9e15d321f1e53748c
[2023-07-02 19:09:23,688 - bdfr.downloader - DEBUG] - Written file to /home/kasia/clonereddit/cyberpunkred/adayat_Inflitrating the Control Center [1st floor, 2nd floor, roof and floorplan] [10x10]_1437tlo_5.jpg
[2023-07-02 19:09:23,688 - bdfr.downloader - DEBUG] - Hash added to master list: a366c5eeac726cc53967bba5d84c73c0
[2023-07-02 19:09:23,688 - bdfr.downloader - INFO] - Downloaded submission 1437tlo from cyberpunkred
[2023-07-02 19:09:23,689 - bdfr.archive_entry.submission_archive_entry - DEBUG] - Retrieving full comment tree for submission 1437tlo
[2023-07-02 19:09:24,082 - bdfr.archiver - DEBUG] - Writing entry 1437tlo to file in JSON format at /home/kasia/clonereddit/cyberpunkred/adayat_Inflitrating the Control Center [1st floor, 2nd floor, roof and floorplan] [10x10]_1437tlo.json
[2023-07-02 19:09:24,083 - bdfr.archiver - INFO] - Record for entry item 1437tlo written to disk
[2023-07-02 19:09:24,083 - bdfr.downloader - DEBUG] - Attempting to download submission 142mn61
[2023-07-02 19:09:24,084 - bdfr.downloader - DEBUG] - Using SelfPost with url https://www.reddit.com/r/RPGdesign/comments/142mn61/seeking_assistance_with_crafting_a_crafting_system/
[2023-07-02 19:09:24,359 - bdfr.downloader - DEBUG] - Written file to /home/kasia/clonereddit/RPGdesign/ShadowRade_Seeking Assistance With Crafting a Crafting System_142mn61.txt
[2023-07-02 19:09:24,359 - bdfr.downloader - DEBUG] - Hash added to master list: 17cb33a74de77b6b20bfa29dbe36d2ca
[2023-07-02 19:09:24,359 - bdfr.downloader - INFO] - Downloaded submission 142mn61 from RPGdesign
[2023-07-02 19:09:24,360 - bdfr.archive_entry.submission_archive_entry - DEBUG] - Retrieving full comment tree for submission 142mn61
[2023-07-02 19:09:24,798 - bdfr.archiver - DEBUG] - Writing entry 142mn61 to file in JSON format at /home/kasia/clonereddit/RPGdesign/ShadowRade_Seeking Assistance With Crafting a Crafting System_142mn61.json
[2023-07-02 19:09:24,799 - bdfr.archiver - INFO] - Record for entry item 142mn61 written to disk
[2023-07-02 19:09:24,799 - bdfr.downloader - DEBUG] - Attempting to download submission 143b31x
[2023-07-02 19:09:24,800 - bdfr.downloader - DEBUG] - Using SelfPost with url https://www.reddit.com/r/rpg/comments/143b31x/thoughts_on_dice_pools/
[2023-07-02 19:09:25,062 - bdfr.downloader - DEBUG] - Written file to /home/kasia/clonereddit/rpg/InkBladePublishing_Thoughts on Dice Pools?_143b31x.txt
[2023-07-02 19:09:25,063 - bdfr.downloader - DEBUG] - Hash added to master list: 355a684eff60eef948bdf1a75305b61f
[2023-07-02 19:09:25,063 - bdfr.downloader - INFO] - Downloaded submission 143b31x from rpg
[2023-07-02 19:09:25,063 - bdfr.archive_entry.submission_archive_entry - DEBUG] - Retrieving full comment tree for submission 143b31x
[2023-07-02 19:09:25,800 - bdfr.archiver - DEBUG] - Writing entry 143b31x to file in JSON format at /home/kasia/clonereddit/rpg/InkBladePublishing_Thoughts on Dice Pools?_143b31x.json
[2023-07-02 19:09:25,800 - bdfr.archiver - INFO] - Record for entry item 143b31x written to disk
[2023-07-02 19:09:25,801 - bdfr.downloader - DEBUG] - Attempting to download submission 142o2vr
[2023-07-02 19:09:25,801 - bdfr.downloader - DEBUG] - Using SelfPost with url https://www.reddit.com/r/cyberpunkred/comments/142o2vr/help_with_making_corpos_hateable/
[2023-07-02 19:09:26,078 - bdfr.downloader - DEBUG] - Written file to /home/kasia/clonereddit/cyberpunkred/RU5TR3D_Help with making corpos hateable?_142o2vr.txt
[2023-07-02 19:09:26,078 - bdfr.downloader - DEBUG] - Hash added to master list: ef82ba46a9becfc63a301edd1ef89956
[2023-07-02 19:09:26,078 - bdfr.downloader - INFO] - Downloaded submission 142o2vr from cyberpunkred
[2023-07-02 19:09:26,078 - bdfr.archive_entry.submission_archive_entry - DEBUG] - Retrieving full comment tree for submission 142o2vr
[2023-07-02 19:09:27,053 - bdfr.archiver - DEBUG] - Writing entry 142o2vr to file in JSON format at /home/kasia/clonereddit/cyberpunkred/RU5TR3D_Help with making corpos hateable?_142o2vr.json
[2023-07-02 19:09:27,053 - bdfr.archiver - INFO] - Record for entry item 142o2vr written to disk
[2023-07-02 19:09:27,053 - bdfr.downloader - DEBUG] - Attempting to download submission 142kyu7
[2023-07-02 19:09:27,053 - bdfr.downloader - DEBUG] - Using SelfPost with url https://www.reddit.com/r/cyberpunkred/comments/142kyu7/i_made_a_personality_database_list_for_my_campaign/
[2023-07-02 19:09:27,299 - bdfr.downloader - DEBUG] - Written file to /home/kasia/clonereddit/cyberpunkred/atomicpunk88_I made a personality database list for my campaign!_142kyu7.txt
[2023-07-02 19:09:27,299 - bdfr.downloader - DEBUG] - Hash added to master list: 0e373650d291561978546191948fdd03
[2023-07-02 19:09:27,299 - bdfr.downloader - INFO] - Downloaded submission 142kyu7 from cyberpunkred
[2023-07-02 19:09:27,299 - bdfr.archive_entry.submission_archive_entry - DEBUG] - Retrieving full comment tree for submission 142kyu7
[2023-07-02 19:09:27,597 - bdfr.archiver - DEBUG] - Writing entry 142kyu7 to file in JSON format at /home/kasia/clonereddit/cyberpunkred/atomicpunk88_I made a personality database list for my campaign!_142kyu7.json
[2023-07-02 19:09:27,597 - bdfr.archiver - INFO] - Record for entry item 142kyu7 written to disk
[2023-07-02 19:09:27,597 - bdfr.downloader - DEBUG] - Attempting to download submission 141vl8i
[2023-07-02 19:09:27,597 - bdfr.downloader - DEBUG] - Using SelfPost with url https://www.reddit.com/r/dndnext/comments/141vl8i/how_have_you_made_mind_flayers_actually_scary_in/
[2023-07-02 19:09:27,856 - bdfr.downloader - DEBUG] - Written file to /home/kasia/clonereddit/dndnext/Neongelion_How have you made mind flayers actually scary in your games?_141vl8i.txt
[2023-07-02 19:09:27,857 - bdfr.downloader - DEBUG] - Hash added to master list: 6794e0561425ba52ce502e0967277cad
[2023-07-02 19:09:27,857 - bdfr.downloader - INFO] - Downloaded submission 141vl8i from dndnext
[2023-07-02 19:09:27,857 - bdfr.archive_entry.submission_archive_entry - DEBUG] - Retrieving full comment tree for submission 141vl8i
[2023-07-02 19:09:29,080 - bdfr.archiver - DEBUG] - Writing entry 141vl8i to file in JSON format at /home/kasia/clonereddit/dndnext/Neongelion_How have you made mind flayers actually scary in your games?_141vl8i.json
[2023-07-02 19:09:29,080 - bdfr.archiver - INFO] - Record for entry item 141vl8i written to disk
[2023-07-02 19:09:29,080 - bdfr.downloader - DEBUG] - Attempting to download submission 140op9g
[2023-07-02 19:09:29,081 - bdfr.downloader - DEBUG] - Using SelfPost with url https://www.reddit.com/r/gurps/comments/140op9g/is_there_a_narrative_version_of_gurps/
[2023-07-02 19:09:29,332 - bdfr.downloader - DEBUG] - Written file to /home/kasia/clonereddit/gurps/Ananiujitha_Is There a Narrative Version of GURPS?_140op9g.txt
[2023-07-02 19:09:29,332 - bdfr.downloader - DEBUG] - Hash added to master list: 234e15a04a3ce1ad37148f9ec48b3e2c
[2023-07-02 19:09:29,332 - bdfr.downloader - INFO] - Downloaded submission 140op9g from gurps
[2023-07-02 19:09:29,332 - bdfr.archive_entry.submission_archive_entry - DEBUG] - Retrieving full comment tree for submission 140op9g
[2023-07-02 19:09:29,958 - bdfr.archiver - DEBUG] - Writing entry 140op9g to file in JSON format at /home/kasia/clonereddit/gurps/Ananiujitha_Is There a Narrative Version of GURPS?_140op9g.json
[2023-07-02 19:09:29,959 - bdfr.archiver - INFO] - Record for entry item 140op9g written to disk
[2023-07-02 19:09:29,959 - bdfr.downloader - DEBUG] - Attempting to download submission 13zomtd
[2023-07-02 19:09:29,959 - bdfr.downloader - DEBUG] - Using SelfPost with url https://www.reddit.com/r/RPGdesign/comments/13zomtd/can_pendragons_blackjack_style_roll_resolution/
[2023-07-02 19:09:30,244 - bdfr.downloader - DEBUG] - Written file to /home/kasia/clonereddit/RPGdesign/Kubsterrb17_Can Pendragon's black-jack style roll resolution mechanic be improved in any way?_13zomtd.txt
[2023-07-02 19:09:30,246 - bdfr.downloader - DEBUG] - Hash added to master list: 30a89f22cb820e5ff2a37d708df53c58
[2023-07-02 19:09:30,246 - bdfr.downloader - INFO] - Downloaded submission 13zomtd from RPGdesign
[2023-07-02 19:09:30,246 - bdfr.archive_entry.submission_archive_entry - DEBUG] - Retrieving full comment tree for submission 13zomtd
[2023-07-02 19:09:31,143 - bdfr.archiver - DEBUG] - Writing entry 13zomtd to file in JSON format at /home/kasia/clonereddit/RPGdesign/Kubsterrb17_Can Pendragon's black-jack style roll resolution mechanic be improved in any way?_13zomtd.json
[2023-07-02 19:09:31,144 - bdfr.archiver - INFO] - Record for entry item 13zomtd written to disk
[2023-07-02 19:09:31,144 - root - INFO] - Program complete

@Zireael07
Copy link
Author

Seriously, bdfr executable should say (or have a readme next to executable) where the logs are stored instead of the user having to scroll through a very long readme on the repo to find out

@Serene-Arc
Copy link
Owner

That's why Ctrl+f was invented. Thank you, I'll see if I can fix this bug.

@Serene-Arc Serene-Arc self-assigned this Jul 3, 2023
@jkexbx
Copy link

jkexbx commented Jul 12, 2023

I can confirm it's definitely from saved comments. I have a lot more and it skips them every time with "is not a submission"

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@Serene-Arc Serene-Arc

Labels
bug Something isn't working
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@jkexbx @Zireael07 @Serene-Arc