🕷️ The BEST Web Scraping framework that handles everything from a single request to a full-scale crawl! Don't be shy, join here: https://discord.gg/EMgGbDceNQ and follow here for daily tips and tricks: https://x.com/Scrapling_dev
Python aiai-scrapingautomationcrawlercrawlingcrawling-pythondatadata-extractionmcpmcp-serverplaywrightpythonscrapingselectorsstealthweb-scraperweb-scrapingweb-scraping-pythonwebscrapingxpath
Commits on main
fix(stealth): stop forcing en-US so the browser follows the system locale (fixes #381)
11cd295 Karim shoair committed 3 months ago
fix(spiders): preserve cookies for browser-engine responses in cache (#379)
b5c8963 Karim shoair committed 3 months ago
fix: remove dead fetchall() after INSERT and correct retrieve() error message (#377)
2f40055 Semianchuk Vitalii committed 3 months ago
fix(spiders): preserve cookies for browser-engine responses in cache (#376)
3ed4fde Amit Vijapur committed 4 months ago
perf(parser): skip re-walking nested ignored subtrees when building the ignored set
ed0202f yetval committed 4 months ago
perf(parser): make Selector.get_all_text() O(nodes) by precomputing ignored subtrees
f4fc6a1 yetval committed 4 months ago
perf: lazily wrap elements in find_by_text/find_by_regex so first_match short-circuits (#370)
97ef582 Karim shoair committed 4 months ago
fix(ai): strip control characters before extraction (#368)
338ab58 Karim shoair committed 4 months ago