Scrapy, a fast high-level web crawling & scraping framework for Python.
Commits on master
Document cb_kwargs/meta deep-copy when JOBDIR is set (#7573)
e0a7de7 Labib Bin Salam committed 5 months ago
Clarify the first-class-citizen nature of asyncio support (#7599)
e7f229f Adrian committed 5 months ago
Fix the check for sync ITEM_PROCESSOR methods. (#7589)
cd25ece Andrey Rakhmatullin committed 5 months ago
Update default_settings, deprecate CRAWLSPIDER_FOLLOW_LINKS. (#7592)
beb6c51 Andrey Rakhmatullin committed 5 months ago
Add support for HTTP/2 and for SOCKS proxies to HttpxDownloadHandler, improve handler docs (#7575)
4e956bd Andrey Rakhmatullin committed 5 months ago
Allow configuring the log level of the retry give-up message (#7567)
d2290c3 Adnan Awan committed 5 months ago
Add settings for TLS min/max version as a replacement for the TLS method (#6546)
d9e2f5f Andrey Rakhmatullin committed 5 months ago
docs: switch `scrapy.Item` examples to dataclasses (#7513)
5149e2c Omkar Kabde committed 5 months ago
Work around coverage slowness on Python 3.14. (#7574)
58af57a Andrey Rakhmatullin committed 5 months ago
fix open_in_browser() logic issue plus add new tests (#7506)
df2f3d7 Ethan Kuo committed 5 months ago
Refactor test_crawl.py and test_crawler.py. (#7566)
fed75a6 Andrey Rakhmatullin committed 5 months ago
Convert tests that fail with testfixtures 12.0.0 (#7545)
90deebe Andrey Rakhmatullin committed 5 months ago
DOC -> Add missing documentation for CloseSpider & CoreStats (#7421)
4a16550 SpiliosDmk committed 6 months ago
Add BaseStreamingDownloadHandler and migrate HttpxDownloadHandler to it. (#7524)
f875af4 Andrey Rakhmatullin committed 6 months ago
Remove support for sync process_spider_output(). (#7504)
a8a8f20 Andrey Rakhmatullin committed 6 months ago
Fix certificate issuer verification on new Twisted. (#7520)
85c616c Andrey Rakhmatullin committed 6 months ago
Document TLS method setting in avoiding bans guide (#7518)
ae4a8e3 Olivia Choi committed 6 months ago