Scrapy, a fast high-level web crawling & scraping framework for Python.
Commits on master
Update expectations of cookies after redirects. (#6367)
631fc65 Andrey Rakhmatullin committed 2 years ago
Merge branch 'master' into typing-request-response-cls
d97d32c Andrey Rakhmatullin committed 2 years ago
Add SpiderLoggerAdapter, change Spider.logger to return SpiderLoggerAdapter (#6324)
b88f22c Bagaudin Magomedov committed 2 years ago
Add Downloader.get_slot_key() without a spider parameter (#6352)
c9ef520 Sanchay Kumar committed 2 years ago
Make certain args of ScrapyAgent and TunnelingAgent required (#6349)
ae7bb84 Sanchay Kumar committed 2 years ago
Update METAREFRESH_IGNORE_TAGS default value in documentation
2e13a9b aisha-partha committed 2 years ago
Closes #6342. Update documentation on METAREFRESH_IGNORE_TAGS default value change
3590a1f aisha-partha committed 2 years ago
Closes #6342. Setting METAREFRESH_IGNORE_TAGS to [‘noscript’] by default
180bc9b aisha-partha committed 2 years ago
Merge pull request #6341 from wRAR/typing-downloader
c9bac7a Andrey Rakhmatullin committed 2 years ago
More typing for scrapy/core/downloader/handlers/http11.py.
045387e Andrey Rakhmatullin committed 2 years ago
Full typing for scrapy/core/downloader/handlers/http10.py.
af3e38a Andrey Rakhmatullin committed 2 years ago
Full typing for scrapy/core/downloader/handlers/ftp.py.
e8e13eb Andrey Rakhmatullin committed 2 years ago
Small typing improvements in scrapy/core/downloader/contextfactory.py.
c4d2748 Andrey Rakhmatullin committed 2 years ago
Merge pull request #6337 from wRAR/typing-linkextractors
8a083fb Andrey Rakhmatullin committed 2 years ago