🕷️ The BEST Web Scraping framework that handles everything from a single request to a full-scale crawl! Don't be shy, join here: https://discord.gg/EMgGbDceNQ and follow here for daily tips and tricks: https://x.com/Scrapling_dev
Python aiai-scrapingautomationcrawlercrawlingcrawling-pythondatadata-extractionmcpmcp-serverplaywrightpythonscrapingselectorsstealthweb-scraperweb-scrapingweb-scraping-pythonwebscrapingxpath
Commits on main
fix(skill): Fix broken markdown links in skill references (#204)
2e78b3f Karim shoair committed 8 months ago
test: add edge case tests for filter, iterancestors, and find_similar (#200)
7ca02eb Karim shoair committed 8 months ago
Merge branch 'dev' into test/edge-cases-filter-ancestors-find-similar
bf9e2da Karim shoair committed 8 months ago
fix(fetchers/content): increase the default max number of retries and raise error on max retries
1dc0b7a Karim shoair committed 8 months ago
fix(fetchers): add max retry limit to _get_page_content to prevent infinite loop (#197)
17ea982 Karim shoair committed 8 months ago
fix(spider/fetcher): preserve HTTP method across retries in spider session (#201)
d9932f2 Karim shoair committed 8 months ago
Merge branch 'dev' into fix/preserve-http-method-on-retry
4c07b29 Karim shoair committed 8 months ago
fix(Texthandler): Replace `get_all` with `getall` to match the `Selector` class
136c389 Karim shoair committed 8 months ago
test: add coverage for `TextHandler` regex paths and `TextHandlers.re()` (#194)
980be18 Karim shoair committed 8 months ago
fix: replace bare raise with return False in _restore_from_checkpoint (#196)
1fb7961 Karim shoair committed 8 months ago
Merge branch 'dev' into fix/checkpoint-restore-bare-raise
bcd45e4 Karim shoair committed 8 months ago
fix: preserve HTTP method across retries in spider session
5bf921b karesansui committed 8 months ago
test: add edge case tests for filter, iterancestors, and find_similar
cec5acd awanawona committed 8 months ago