Skip to content

Scrapy, a fast high-level web crawling & scraping framework for Python.

Commits on master

Claude now supports AGENTS.md (#8188)
Adrian committed 2 months ago
b6ac785
Bump Ruff to 0.16. (#8182)
Andrey Rakhmatullin committed 2 months ago
4f3e27e
Typing improvements (#8183)
Andrey Rakhmatullin committed 2 months ago
9afd131
Make ExecutionEngine a state machine. (#8181)
Andrey Rakhmatullin committed 2 months ago
5ecc3f5
Don't start the engine in the shell. (#8179)
Andrey Rakhmatullin committed 2 months ago
fe30c18
Switch the shell to download_async() (#8176)
Andrey Rakhmatullin committed 2 months ago
3a799fd
Report crawl errors in scrapy check (#7991)
Adrian committed 2 months ago
a45b758
Make copy.copy() work on Item (#8172)
Adrian committed 2 months ago
991a29e
Build the scheduler before assinging engine.spider. (#8169)
Andrey Rakhmatullin committed 2 months ago
cdc5a75
Wait for engine_started in the reactorless shell init (#8168)
Andrey Rakhmatullin committed 2 months ago
9008b6d
ee9a21b
Align SPIDER_MIDDLEWARES_BASE docs with the value. (#8166)
Andrey Rakhmatullin committed 2 months ago
7bb7372
Add StickyMetaParamsMiddleware (#7711)
Adnan Awan committed 2 months ago
744aaae
Address typos and grammar issues in docs/ (#7114)
Adrián Chaves committed 2 months ago
03e2c03
7574d00
c05bfb5
Add a PR template (#8154)
Adrian committed 2 months ago
d3cea51