Scrapy, a fast high-level web crawling & scraping framework for Python.
Commits on master
Bump certifi from 2026.7.22 to 2026.10.19 in /docs (#8384)
ca5f3c1 dependabot[bot] committed 1 month ago
Pause request processing based on the sum of body sizes of all active responses (#6430)
ffe67f8 Adrián Chaves committed 1 month ago
Order the Cookie header by path length, then creation time (#8321)
708bc4c Hygor luz committed 1 month ago
Work around a rare aiodns port problem on Windows. (#8382)
323f075 Andrey Rakhmatullin committed 1 month ago
Add tests for how handlers change the header capitalization. (#8381)
33ac758 Andrey Rakhmatullin committed 1 month ago
Add REDIRECT_HTTP_CODES for 201 redirect support and Response.follow_redirect() (#7801)
f0f6fd5 Adrian committed 1 month ago
Add CONCURRENT_CONNECTIONS_PER_HANDLER and CONNECTION_KEEPALIVE_TIMEOUT (#7932)
ee068e7 Adrian committed 1 month ago
Close download handlers even if the engine wasn't started. (#8377)
1038ede Andrey Rakhmatullin committed 1 month ago
Make HttpCacheMiddleware wait for in-flight downloads of the same resource (#7915)
962197e Adrian committed 1 month ago
Remove wrapping callbck exceptions into Failures. (#8363)
67bf407 Andrey Rakhmatullin committed 1 month ago