Scrapy, a fast high-level web crawling & scraping framework for Python.
Commits on master
Add flake8-comprehensions and flake8-debugger rules to ruff.
e53d6f0 Andrey Rakhmatullin committed 1 year ago
Made path absolute to enable running pytest from a different directory. (#6567)
5680bee Emery Berger committed 1 year ago
Merge pull request #6560 from wRAR/tls-method-tests
37be9da Andrey Rakhmatullin committed 1 year ago
Add tests for DOWNLOADER_CLIENT_TLS_METHOD, remove dead code.
4dcc04b Andrey Rakhmatullin committed 1 year ago
Merge pull request #6545 from wRAR/mitmproxy-dhparam
212e848 Andrey Rakhmatullin committed 2 years ago
Merge pull request #6543 from scrapy/pep740-attestations
87b2300 Andrey Rakhmatullin committed 2 years ago
Merge pull request #6542 from nicklaustrup/Tests-contracts-swallowed-exceptions
30fb54f Andrey Rakhmatullin committed 2 years ago
Added failing test cases to tests/test_contracts.py and fixed corresponding methods + removed pylint comments
bfcee45 Nicholas Laustrup committed 2 years ago
Merge pull request #6540 from wRAR/build_from_settings
ab5cb7c Andrey Rakhmatullin committed 2 years ago
Prefer crawler.settings over settings in media pipelines.
6aa4d2b Andrey Rakhmatullin committed 2 years ago
Enhancement: Update docs to include IgnoreRequest details (#6506)
261c4b6 Robert Palmer committed 2 years ago
Deprecate build_from_crawler() calling from_settings().
8700a5b Andrey Rakhmatullin committed 2 years ago
Add from_crawler() to components that only had from_settings().
499e7e8 Andrey Rakhmatullin committed 2 years ago
Add tests for MediaPipeline.from_crawler() and related code.
f796d87 Andrey Rakhmatullin committed 2 years ago
Deprecate scrapy.extensions.feedexport.build_storage() and simplify _get_storage().
83d4939 Andrey Rakhmatullin committed 2 years ago