Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.
TypeScript apifyautomationcrawlercrawlingheadlessheadless-chromejavascriptnodejsnpmplaywrightpuppeteerscraperscrapingtypescriptweb-crawlerweb-crawlingweb-scraping
Add changelog
Ondra Urbancf5f36274b64
diff --git a/CHANGELOG.md b/CHANGELOG.mdindex 5976f575d..411cb764e 100644--- a/CHANGELOG.md+++ b/CHANGELOG.md@@ -1,3 +1,9 @@+0.21.9 / 2020/11/03+====================+- Fix various issues in `stealth`.+- Fix `SessionPool` not retiring sessions immediately when they become unusable.+ It fixes a problem where `PuppeteerPool` would not retire browsers wit bad sessions.+0.21.8 / 2020/10/07====================- Make `PuppeteerCrawler` safe against malformed Puppeteer responses.