Scrapy, a fast high-level web crawling & scraping framework for Python.
Commits on master
Fail with a clear message when Spider.start() is not an asynchronous generator (#7946)
06af687 Adrian committed 3 months ago
Stop the open_in_browser ReDoS tests from failing on slow interpreters (#7995)
f975e92 Adrian committed 3 months ago
Stop test_storage from expiring its cache entry on slow runners (#7993)
ca48915 Adrian committed 3 months ago
Rerun tests that need real Internet access when they fail (#7985)
be514d8 Adrian committed 3 months ago
Stop marking the Twisted-based HTTP/2 download handler as experimental, and privatize its API (#7986)
8bb06bf Adrian committed 3 months ago
Deprecate PeriodicLog.multiplier instead of removing it altogether (#7982)
52cc2da Adrian committed 3 months ago
Deprecate interpolating log formatter messages with the returned dict (#7971)
95c16aa Adrian committed 3 months ago
Serialize dates and times as ISO 8601 in ScrapyJSONEncoder (#7918)
fe96c1f Adrian committed 3 months ago
Implement browser-like bad header handling for the default download handler (#7806)
4cc2356 Adrian committed 3 months ago
Type late Crawler attributes as always set instead of None (#7882)
508bd7f Adrian committed 3 months ago
Document response parsing memory use in the security page (#7930)
09c9181 Adrian committed 3 months ago
Document how to customize media pipeline file names from responses (#7909)
ae68786 Adrian committed 3 months ago
Document how to disallow subdomains of allowed domains (#7903)
d41bfae Adrian committed 3 months ago
Add a docs section on using download_async() from a downloader middleware (#7872)
ba29ce8 Adrian committed 3 months ago