Scrapy, a fast high-level web crawling & scraping framework for Python.
Commits on master
Log skipped urls by length to INFO, add skipped stats
6e5ea79 Dmitriy Pomazunovskiy committed 5 years ago
Merge branch 'master' of https://github.com/scrapy/scrapy into scrapy-4996
2d41c77 deepang17 committed 5 years ago
Merge pull request #3667 from Gallaecio/long-allowed-domains
954c4b4 Andrey Rahmatullin committed 5 years ago
Merge pull request #3 from elacuesta/retry-request-customization
dfd4ab2 Adrián Chaves committed 5 years ago
Allow logger/stats customization in get_retry_request
9e62355 Eugenio Lacuesta committed 5 years ago
docs: Clarify there's one extension instance per spider
3c5668d James McKinney committed 5 years ago
Merge pull request #5002 from djikoSal/refactor-curl-to-request-kwargs
f95ebd8 Mikhail Korobov committed 5 years ago
Close files in the PerYearXmlExportPipeline documentation example
f689615 Adrián Chaves committed 5 years ago
Refactor curl_to_request_kwargs #5001 Co-authored-by: alkazaz [email protected] Co-authored-by: swill [email protected] Co-authored-by: lerjevik [email protected] Co-authored-by: aljica [email protected]
3894ebb Djiar committed 5 years ago
tests/test_downloader_handlers_http2.py: fix style issue
386e2a5 Adrián Chaves committed 5 years ago