🕷️ The BEST Web Scraping framework that handles everything from a single request to a full-scale crawl! Don't be shy, join here: https://discord.gg/EMgGbDceNQ and follow here for daily tips and tricks: https://x.com/Scrapling_dev
Python aiai-scrapingautomationcrawlercrawlingcrawling-pythondatadata-extractionmcpmcp-serverplaywrightpythonscrapingselectorsstealthweb-scraperweb-scrapingweb-scraping-pythonwebscrapingxpath
Commits on main
perf: wrap elements lazily in find_by_text/find_by_regex so first_match short-circuits
aeb0f87 yetval committed 4 months ago
fix: Proper encoding for page content retrieved via Playwright (#365)
2e0c7b0 Karim shoair committed 4 months ago
Merge branch 'dev' into fix-playwright-page-content-encoding
f81a8dc Karim shoair committed 4 months ago
Merge branch 'dev' into fix/issue-350-init-script-page-action
f771e65 Karim shoair committed 4 months ago
Merge branch 'main' into fix/issue-350-init-script-page-action
5ceeceb Karim shoair committed 4 months ago
Merge branch 'dev' into fix-linkextractor-compound-extensions
13eb6b0 Karim shoair committed 4 months ago
fix: keep in-flight requests in checkpoints so resume does not lose them (#358)
296ec8d Karim shoair committed 4 months ago
Merge branch 'dev' into fix/checkpoint-in-flight-requests
82015b3 Karim shoair committed 4 months ago
test: align robots request-rate with Protego 0.6.1 (#355)
1c5c2f9 Karim shoair committed 4 months ago
Merge branch 'dev' into fix/protego-request-rate-baseline
e528d0c Karim shoair committed 4 months ago
Merge branch 'dev' into fix/checkpoint-in-flight-requests
5952cd2 Karim shoair committed 4 months ago
fix: track in-flight requests by queue counter so duplicate instances are not collapsed
95687a5 yetval committed 4 months ago