Skip to content

Scrapy, a fast high-level web crawling & scraping framework for Python.

Commits on master

Add flake8-type-checking rules to ruff.
Andrey Rakhmatullin committed 1 year ago
d47f142
Add pydocstyle/flake8-docstrings rules to ruff.
Andrey Rakhmatullin committed 1 year ago
d6bf146
Add flake8-comprehensions and flake8-debugger rules to ruff.
Andrey Rakhmatullin committed 1 year ago
e53d6f0
Add flake8-bugbear rules to ruff.
Andrey Rakhmatullin committed 1 year ago
c184f12
Add ruff with basic rules. (#6565)
Andrey Rakhmatullin committed 1 year ago
cc146b9
Merge pull request #6560 from wRAR/tls-method-tests
Andrey Rakhmatullin committed 1 year ago
37be9da
Add tests for DOWNLOADER_CLIENT_TLS_METHOD, remove dead code.
Andrey Rakhmatullin committed 1 year ago
4dcc04b
Integrating configs into pyproject.toml (#6547)
Swayam Gupta committed 2 years ago
8c23da9
Fix a typo that broke PDF builds.
Andrey Rakhmatullin committed 2 years ago
efb53aa
Bump version: 2.11.2 → 2.12.0
Andrey Rakhmatullin committed 2 years ago
b1f9e56
2.12 release notes (#6226)
Adrián Chaves committed 2 years ago
10089c6
Merge pull request #6545 from wRAR/mitmproxy-dhparam
Andrey Rakhmatullin committed 2 years ago
212e848
Commit mitmproxy-dhparam.pem.
Andrey Rakhmatullin committed 2 years ago
feea3a0
Merge pull request #6543 from scrapy/pep740-attestations
Andrey Rakhmatullin committed 2 years ago
87b2300
Verified PyPI releases (a.k.a. PEP740)
Daniel Graña committed 2 years ago
dc4d6d1
Merge pull request #6540 from wRAR/build_from_settings
Andrey Rakhmatullin committed 2 years ago
ab5cb7c
Address PR feedback.
Andrey Rakhmatullin committed 2 years ago
929d665
Extract duplicated code.
Andrey Rakhmatullin committed 2 years ago
2ad5f0c
Prefer crawler.settings over settings in media pipelines.
Andrey Rakhmatullin committed 2 years ago
6aa4d2b
Modernize the media pipeline initialization API.
Andrey Rakhmatullin committed 2 years ago
28fafbb
Deprecate build_from_crawler() calling from_settings().
Andrey Rakhmatullin committed 2 years ago
8700a5b
Deprecate MiddlewareManager.from_settings().
Andrey Rakhmatullin committed 2 years ago
eda1a8a
Add from_crawler() to components that only had from_settings().
Andrey Rakhmatullin committed 2 years ago
499e7e8
Add tests for MediaPipeline.from_crawler() and related code.
Andrey Rakhmatullin committed 2 years ago
f796d87
Remove build_from_settings().
Andrey Rakhmatullin committed 2 years ago
eda3a89