Scrapy, a fast high-level web crawling & scraping framework for Python.
Commits on master
Offer an unhandled exception to each process_spider_exception method only once (#7996)
9344d60 Adrian committed 2 months ago
Document setting request headers for media pipeline requests (#8063)
94d212b Adrian committed 2 months ago
Add optional colored logging via LOG_COLOR and the color extra (#8091)
ebfb049 Adrian committed 2 months ago
Add item to the extra kwargs when logging item processing (#8085)
d9d37a6 Adrian committed 2 months ago
Support setting request and spider arguments when checking contracts (#8053)
3444bdb Adrian committed 2 months ago
Document how to access the response of a failed media download (#8056)
fe130b4 Adrian committed 2 months ago
Make --pdb break on reported errors instead of on every Failure (#8037)
8a0e394 Adrian committed 2 months ago
Support running some benchmarks on a CodSpeed runner to include wall time (#8080)
f30f8bf Adrian committed 2 months ago
Add a parse-heavy crawl benchmark over a saved website snapshot (#8030)
09466c7 Adrian committed 2 months ago
Exclude "Settings documented elsewhere" from llms-full.txt (#8089)
0d1a0ce Adrian committed 2 months ago