Scrapy, a fast high-level web crawling & scraping framework for Python.
Commits on master
CI: Cancel in-progress workflow runs when their pull request is closed (#8029)
09a5d81 Adrian committed 3 months ago
Warn against using keep_fragments for JS-rendered fragment content (#8033)
d2ec88f Adrian committed 3 months ago
Fix a Windows clock-resolution flake in test_file_path_from_response (#8032)
643243e Adrian committed 3 months ago
CI: Start mitmdump once per proxy kind instead of once per test (#8028)
c32cfd3 Adrian committed 3 months ago
Stop sleeping 100 ms before every callback and media result (#8019)
e01783a Adrian committed 3 months ago
Speed up the PyPy CI job and the tests that wait on the engine heartbeat (#8020)
916039c Adrian committed 3 months ago
Ignore the queuelib test file leak as a ResourceWarning too (#8018)
ed98aaf Adrian committed 3 months ago
fix flaky test_slow_pipeline by comparing items unordered (#8008)
685abd6 Anand committed 3 months ago
Use compression.zstd/backports.zstd and make zstd support mandatory (#8009)
3f46d1a Adrian committed 3 months ago
Support IDNA-2003-only domains by monkey-patching Twisted IDNA helpers (#7846)
d12db69 Laerte Pereira committed 3 months ago
Unpack some test classes that are just containers. (#8000)
c7eacdb Andrey Rakhmatullin committed 3 months ago
Move the parsel version check to _deps_compat, drop the w3lib ones (#8001)
e810f5f Andrey Rakhmatullin committed 3 months ago
Do not run item pipelines or feed exports on scrapy check (#7957)
e06ad76 Adrian committed 3 months ago
Fix open_in_browser not adding a base tag without a head element (#7879)
23abf7e Adrian committed 3 months ago
Warn when feeds are configured but FeedExporter is disabled (#7902)
60b1bad Adrian committed 3 months ago
Return exit code 1 from check, parse and fetch on bootstrap errors (#7920)
d772acd Adrian committed 3 months ago