Skip to content

Pull requests: scrapy/scrapy

New pull request New
208 Open 3,661 Closed
208 Open 3,661 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

Allow Crawler.crawl_async() without asyncio. asyncio enhancement
#7202 opened Dec 27, 2025 by wRAR Loading… Scrapy 2.14
1
Replace deprecated codecov/test-results-action with codecov-action@v5
#7200 opened Dec 26, 2025 by ShashankSaga Loading…
1
1
Foundations for the reactorless mode. asyncio enhancement
#7199 opened Dec 24, 2025 by wRAR • Draft
3
5
[WIP] Remove deprecated codecov/test-results-action from CI workflows
#7194 opened Dec 18, 2025 by IkramKhanNiazi • Draft
1
3
Await persist_file() in media pipelines. asyncio bug
#7182 opened Dec 16, 2025 by wRAR • Draft
1
3
Refactor AutoThrottle and deprecate the download_delay spider attr (#7167)
#7175 opened Dec 13, 2025 by DenisC96 Loading…
1
5
Allow specifying sitemap meta
#7174 opened Dec 12, 2025 by vrana Loading…
1
Async API for download handlers. asyncio enhancement
#7164 opened Nov 28, 2025 by wRAR Loading… Scrapy 2.14
2
16
File download error fix at staus code 201
#7130 opened Oct 28, 2025 by rohan45327 Loading…
3
Docs: Request callbacks
#7119 opened Oct 24, 2025 by Suchi1905 Loading…
1
8
Added structured logging to systemd journal.
#7115 opened Oct 24, 2025 by AliAlimohammadi Loading…
38
Address typos and grammar issues in docs/
#7114 opened Oct 23, 2025 by Gallaecio • Draft
1
Docs: Cleaned and added proper JOBDIR file documentation (fixes #4842)
#7110 opened Oct 20, 2025 by veerasai06 Loading…
1
6
Document files created in JOBDIR: requests.seen, requests.queue, etc.
#7108 opened Oct 19, 2025 by louraider Loading…
1
scrapy-spider-metadata docs added
#7096 opened Oct 15, 2025 by vasiliyk Loading…
1
1
Ipv6 support for proxy
#7090 opened Oct 12, 2025 by vasiliyk Loading…
1
9
Support for Python 3.14 compression.zstd
#7083 opened Oct 7, 2025 by vasiliyk Loading…
1
1
add tests for #7036
#7078 opened Oct 5, 2025 by albertedwardson • Draft
tests(memusage): add unit tests covering scrapy.extensions.memusage.MemoryUsage (resolves #7002) stale
#7061 opened Sep 29, 2025 by T-leke • Draft
1
4
Docs: clarify JOBDIR common files (requests.seen, spider.state) (#4842)
#7056 opened Sep 25, 2025 by TJPcodes Loading…
Reducing memory footprint of Request object: __slots__ and lazy evaluation enhancement performance
#7036 opened Sep 1, 2025 by albertedwardson Loading…
10
Release notes for 2.14.0 docs
#7035 opened Aug 31, 2025 by wRAR • Draft Scrapy 2.14
3
tests: integration coverage for memusage extension
#7017 opened Aug 22, 2025 by Lions-1 Loading…
1
18
Optimise SitemapSpider memory usage enhancement performance
#7007 opened Aug 12, 2025 by albertedwardson Loading…
1
38
test: Cover scrapy.extensions.memusage.MemoryUsage
#7004 opened Aug 11, 2025 by prakashsellathurai • Draft
1
12
ProTip! Updated in the last three days: updated:>2025-12-25.