🕷️ The BEST Web Scraping framework that handles everything from a single request to a full-scale crawl! Don't be shy, join here: https://discord.gg/EMgGbDceNQ and follow here for daily tips and tricks: https://x.com/Scrapling_dev
Python aiai-scrapingautomationcrawlercrawlingcrawling-pythondatadata-extractionmcpmcp-serverplaywrightpythonscrapingselectorsstealthweb-scraperweb-scrapingweb-scraping-pythonwebscrapingxpath
Commits on main
test(ai): add _normalize_credentials edge case coverage (#192)
e63e57e Karim shoair committed 8 months ago
Merge branch 'dev' into test/normalize-credentials-coverage
656dbc7 Karim shoair committed 8 months ago
fix: add max retry limit to _get_page_content to prevent infinite loop
d3c251c haosenwang1018 committed 8 months ago
fix: replace bare raise with return False in _restore_from_checkpoint
a31763a haosenwang1018 committed 8 months ago
test: add coverage for TextHandler regex, clean, and TextHandlers.re()
7178279 haosenwang1018 committed 8 months ago
test: add save/retrieve round-trip and hash/URL coverage for storage core
2974234 haosenwang1018 committed 8 months ago
test(ai): add _normalize_credentials edge case coverage
54fcb7c Andrew Barnes committed 8 months ago
fix(agent): update the agent skill zip file with the new version
66e0e7a Karim shoair committed 8 months ago
docs: update the website to reflect the google referer logic
73832f9 Karim shoair committed 8 months ago
fix: update code and docstrings to remove the old google referer logic
a929de6 Karim shoair committed 8 months ago
fix: return bare Google URL in referer instead of search query (#179)
aa6f96e Karim shoair committed 8 months ago