Scrapy, a fast high-level web crawling & scraping framework for Python.
Commits on master
Use Headers.to_string() in FilesystemCacheStorage. (#8491)
0dceca5 Andrey Rakhmatullin committed 6 days ago
Allow empty port or creds in FTPFilesStore. (#8490)
1bdb348 Andrey Rakhmatullin committed 6 days ago
Stop passing media_downloaded() errors to media_failed(). (#8489)
034d9bc Andrey Rakhmatullin committed 6 days ago
Use canonical HTTP status names from stdlib. (#8487)
758eb5b Andrey Rakhmatullin committed 6 days ago
Do not warn about requests built by get_retry_request() (#8472)
f1e29c3 hammadqureshi-web committed 7 days ago
Unify HTTP code handling configuration for the error and redirect middlewares (#7799)
0e77fdf Adrian committed 7 days ago
Force download timeouts in BaseStreamingDownloadHandler. (#8481)
aeaec6a Andrey Rakhmatullin committed 7 days ago
Support coros in schedulers and dupefilters. (#8479)
f7b1fd3 Andrey Rakhmatullin committed 9 days ago
Fix frostwork and typing-extensions versions in the 2.20.0 release notes
373d914 Adrian Chaves committed 13 days ago
Make MetaRefresh a dataclass not exported from scrapy.http
c6b1743 Adrian Chaves committed 13 days ago
Link extractors and SitemapSpider follow file://, ftp:// and s3:// URLs from crawled content
2b30fee Adrian Chaves committed 13 days ago
Files and images pipelines send S3 requests over plaintext HTTP by default
5204544 Adrian Chaves committed 13 days ago
Redirects to no_proxy hosts sent through the environment proxy
6621b09 Adrian Chaves committed 13 days ago
Per-request http_user and http_pass credentials leaked on cross-domain redirects
08f4176 Adrian Chaves committed 13 days ago
Unbounded Content-Encoding decompression chain allows denial of service
06c866b Adrian Chaves committed 13 days ago
Do not count body_file requests toward RESPONSE_MAX_ACTIVE_SIZE (#8466)
9ddd3a7 Adrian committed 13 days ago
Return partial HTTP/2 responses on timeout when fail_on_dataloss is False (#8464)
36a7e21 Adrian committed 14 days ago
Limit memory used by media pipeline and other download_async() requests (#8417)
a0e3b34 Adrian committed 14 days ago