Scrapy, a fast high-level web crawling & scraping framework for Python.
Commits on master
CI: Promote Python 3.15 to stable, drop redundant test jobs (#8361)
edef024 Adrian committed 1 month ago
Restore test coverage for "if self.downloader.active". (#8359)
30e9c7c Andrey Rakhmatullin committed 1 month ago
Fail leaked aiohttp sessions in place, close subprocess on failed expect (#8194)
ebec11a Adrian committed 1 month ago
Make listen_tcp() more robust to concurrent binds. (#8356)
d1bcaee Andrey Rakhmatullin committed 1 month ago
Add a downloader middleware to translate URI userinfo data into Request.meta keys (#4474)
a975581 Adrián Chaves committed 1 month ago
Document the error argument of spider_closed. (#8357)
97d08de Andrey Rakhmatullin committed 1 month ago
Don't consider the spider idle with self._slot.inprogress. (#8355)
bc824d2 Andrey Rakhmatullin committed 1 month ago
Add missed CloseSpider.error handling for downloader middlewares. (#8352)
b678e91 Andrey Rakhmatullin committed 1 month ago
Fail HTTP/2 requests when the connection cannot be established (#8332)
ab6c325 Adrian committed 1 month ago
Extend the warning filter in set_asyncio_event_loop_policy(). (#8353)
beebab4 Andrey Rakhmatullin committed 1 month ago
Let a stop finish while an item is in the item pipelines (#8348)
7df2b70 Adrian committed 1 month ago
Preserve contextvars across reactor-scheduled callbacks (#8347)
14a6030 Adrian committed 1 month ago
Warn about signal handler arguments the signal never sends (#8345)
46c3eda Adrian committed 1 month ago
Treat HTTP 201 as a successful download in FilesPipeline (#8349)
09b84e3 Adrian committed 1 month ago
Only send http_user/http_pass to the origin they were first used on (#8329)
502caa2 Adrian committed 1 month ago
Add LOG_ROOT_FORMATTER to customize the root log handler formatter (#8336)
707357e Adrian committed 1 month ago
Bracket IPv6 destinations in HTTP proxy CONNECT requests (#8343)
377fc4e Adrian committed 1 month ago
Re-resolve the download slot of redirects and retries to another domain (#8337)
78f4b3f Adrian committed 1 month ago