🕷️ The BEST Web Scraping framework that handles everything from a single request to a full-scale crawl! Don't be shy, join here: https://discord.gg/EMgGbDceNQ and follow here for daily tips and tricks: https://x.com/Scrapling_dev
Python aiai-scrapingautomationcrawlercrawlingcrawling-pythondatadata-extractionmcpmcp-serverplaywrightpythonscrapingselectorsstealthweb-scraperweb-scrapingweb-scraping-pythonwebscrapingxpath
Commits on main
fix: keep in-flight requests in checkpoints so resume does not lose them
d1082bd yetval committed 5 months ago
Revert "fix: make stealth init scripts available to page actions"
41054ba mehmet turac committed 5 months ago
fix: make stealth init scripts available to page actions
9a6d3a8 mehmet turac committed 5 months ago
fix: apply the session-level proxy when no per-request proxy is given
74c5848 Karim shoair committed 5 months ago
fix: parse quoted charset values in content-type headers (#323)
061f778 Karim shoair committed 5 months ago
docs: warn that the default installation doesn't include fetchers
b3408c6 Karim shoair committed 5 months ago
fix: prevent `IndexError` in adaptive relocation when `auto_save` is enabled (#340)
1fd1013 Karim shoair committed 5 months ago
Merge branch 'dev' into fix/adaptive-autosave-indexerror
3d96baf Karim shoair committed 5 months ago
fix(parser): use max of both attribute counts in similarity scoring denominator
9c0c857 Karim shoair committed 5 months ago
fix(spiders): use `os.replace` for atomic checkpoint/cache writes on Windows (#344)
f7d1e33 Karim shoair committed 5 months ago
Merge branch 'dev' into fix/atomic-checkpoint-cache-writes
4f0a593 Karim shoair committed 5 months ago
fix(spiders): use os.replace for atomic checkpoint/cache writes on Windows
f0db3d7 Ahmed Elshahat committed 5 months ago