Scrapy, a fast high-level web crawling & scraping framework for Python.
Commits on master
Fix max_concurrent_requests deprecation version in 2.18.0 notes (#8151)
739d729 Adrian committed 2 months ago
Handle valid curl inputs in Request.from_curl (#8131) (#8138)
86bec33 Vinícius Silva Campos committed 2 months ago
Exit non-zero when crawl closes via CLOSESPIDER_ERRORCOUNT (#8082)
2af4532 Adrian committed 2 months ago
Deprecate defining XMLFeedSpider.parse_item(). (#8147)
bb22ac0 Andrey Rakhmatullin committed 2 months ago
Deprecate `is_asyncio_reactor_installed()` (#8128)
a527168 Andrey Rakhmatullin committed 2 months ago
Close flagged PRs as spam instead of labelling them for triage (#8127)
f9157d3 Adrian committed 2 months ago
Read DNS and thread pool settings from the first spider (#7923)
e162000 Adrian committed 2 months ago
Remove Sphinx module synopsis attributes and make a smarter use of module/currentmodule to minimize typing (#8011)
99323bd Adrian committed 2 months ago
Close telnet connection on exit() to avoid an unhandled error log (#8065)
9b3bef3 Adrian committed 2 months ago
Shortcut for install_reactor() with the asyncio reactor/ (#8125)
ae97d4f Andrey Rakhmatullin committed 2 months ago
Fix LocalCache evicting a different key when updating an existing key (#8113)
a410975 Anish Patel committed 2 months ago
Add AiohttpDownloadHandler and switch reactorless to it (#8118)
41c3f3e Andrey Rakhmatullin committed 2 months ago
Implement some idioms from newer Python versions. (#8123)
20dcf82 Andrey Rakhmatullin committed 2 months ago
Expose HTTP cache storage timestamp via the cache_timestamp meta key (#8034)
6057f02 Adrian committed 2 months ago
Fix missing certificate and IP address on HTTP/1.1 responses without a body (#8048)
544f4d2 Adrian committed 2 months ago
Infer the FEEDS format from the feed URI's file extension when not set (#8031)
f44abb9 Adrian committed 2 months ago
Add LOG_INSTALL_ROOT_HANDLER setting and deprecate the install_root_handler parameter (#8041)
f9ade92 Adrian committed 2 months ago
Add the project directory to sys.path even when SCRAPY_SETTINGS_MODULE is set (#8042)
ca1f326 Adrian committed 2 months ago