Scrapy, a fast high-level web crawling & scraping framework for Python.
Commits on master
Type the request attribute Scrapy adds to Failure objects (#8078)
6d53f9b Adrian committed 1 month ago
Improve sleep calculation in AsyncioLoopingCall. (#8294)
dbcb9e0 Andrey Rakhmatullin committed 1 month ago
Add a test that compares default setting values. (#8314)
fd4a7d8 Andrey Rakhmatullin committed 1 month ago
Implement a close reason for robots.txt affecting all start requests (#6164)
52f7d6a Adrián Chaves committed 1 month ago
Fix the fast stop hanging when it cancels a download before it starts. (#8312)
15a3cf4 Andrey Rakhmatullin committed 1 month ago
Replace loops with parametrize() in feedexport tests. (#8301)
be7bdc4 Andrey Rakhmatullin committed 1 month ago
Cache URL parses per URL and parse fewer URLs per request (#8247)
229c1b8 Adrian committed 1 month ago
Fix the fast stop hanging with a download in flight on asyncio. (#8296)
03b2b7b Andrey Rakhmatullin committed 1 month ago
Honor request priority across the scheduler memory and disk queues (#8237)
2c9804b Adrian committed 1 month ago
Fix fragment inheritance for redirects with an empty fragment (#8100)
0778a74 cui fliter committed 1 month ago
Deprecate sync Scraper.handle_spider_output_async() input. (#8288)
e8d545a Andrey Rakhmatullin committed 1 month ago
Switch the spam PR check to scrapy/unattended-pr-guard 0.2.0 (#8286)
eba114d Adrian committed 1 month ago
Run errback output through the spider middlewares on download errors (#7992)
948e8e3 Adrian committed 1 month ago
Use fixtures and export_by_format() in TestFeedExport. (#8280)
47a270d Andrey Rakhmatullin committed 1 month ago
Stop using TestFeedExportBase in the async feed export tests. (#8279)
9d29beb Andrey Rakhmatullin committed 1 month ago
Stop using TestFeedExportBase in the batch delivery tests. (#8278)
759367d Andrey Rakhmatullin committed 1 month ago