🕷️ The BEST Web Scraping framework that handles everything from a single request to a full-scale crawl! Don't be shy, join here: https://discord.gg/EMgGbDceNQ and follow here for daily tips and tricks: https://x.com/Scrapling_dev
Python aiai-scrapingautomationcrawlercrawlingcrawling-pythondatadata-extractionmcpmcp-serverplaywrightpythonscrapingselectorsstealthweb-scraperweb-scrapingweb-scraping-pythonwebscrapingxpath
Commits on main
fix(parser): Better approach for web pages where the encoding is not always correctly declared
1702055 Karim shoair committed 12 months ago
feat(TextHandler): Add argument to `clean` method to remove html entities
fb80beb Karim shoair committed 1 year ago
feat(fetcher): Make `impersonate` able to randomize fingerprint
3565f9d Karim shoair committed 1 year ago
feat: replace `raw_response` property with smart content detection
ff19dd5 Karim shoair committed 1 year ago
fix: added `raw_response` to separate collected response from rendered response
df073c4 Karim shoair committed 1 year ago