Skip to content

Scrapy, a fast high-level web crawling & scraping framework for Python.

Commits on master

Deprecate HTTP/1.0 support.
Andrey Rakhmatullin committed 1 year ago
d27c6b4
Fix error when running `scrapy bench` (#6633)
Lidiane T committed 1 year ago
98a57e2
Bump ruff, switch from black to ruff-format (#6631)
Andrey Rakhmatullin committed 1 year ago
cec0aec
Drop PyPy 3.9, add a pypy3-extra-deps CI job. (#6613)
Andrey Rakhmatullin committed 1 year ago
d4b152b
Upgrade Sphinx (#6624)
Rotzbua committed 1 year ago
7e61ff3
Merge pull request #6626 from Laerte/master
Andrey Rakhmatullin committed 1 year ago
499b6c6
Allow updating pre-crawler settings from add-ons (#6568)
guillermo-bondonno committed 1 year ago
9bc0029
fix: test_s3_export fails with boto3 >= 1.36.0
Laerte Pereira committed 1 year ago
14219b1
chore(docs): refactor config (#6623)
Rotzbua committed 1 year ago
e0c828b
Merge pull request #6622 from Rotzbua/fix_docs_broken_link
Andrey Rakhmatullin committed 1 year ago
8bc8f75
ee4f527
Merge pull request #6621 from Rotzbua/chore_docs_rtd_template
Andrey Rakhmatullin committed 1 year ago
782e286
chore(docs): migrate to RTD template v3
Rotzbua committed 1 year ago
d716857
Fix _pop_command_name (#6606)
anubhav committed 1 year ago
1c1e838
Change unknown cmd message when outside project (#3426)
Ionut-Cezar Ciubotariu committed 1 year ago
402500b
new `allow_offsite` parameter in OffsiteMiddleware (#6151)
Kevin Lloyd Bernal committed 1 year ago
1fc91bb
Merge pull request #6610 from wRAR/coverage-subprocess
Adrián Chaves committed 1 year ago
b6d69e3
Improve coverage speed on Python 3.12+.
Andrey Rakhmatullin committed 1 year ago
3154b08
Fix tracking of coverage in subprocesses.
Andrey Rakhmatullin committed 1 year ago
7dfbecd
59fcb9b
5d3aa80
Fix Crawler.request_fingerprinter typing (#6605)
Laerte Pereira committed 1 year ago
f2234c5
Explicitly mark re-exports. (#6579)
Andrey Rakhmatullin committed 1 year ago
4d31277
Merge pull request #6601 from wRAR/ruff-rules-5
Andrey Rakhmatullin committed 1 year ago
c330a39
Reformat long REFERRER_POLICY.
Andrey Rakhmatullin committed 1 year ago
176ae34
Drop the remaining unittest.main() blocks. (#6602)
Andrey Rakhmatullin committed 1 year ago
6ae5b92