Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.
TypeScript apifyautomationcrawlercrawlingheadlessheadless-chromejavascriptnodejsnpmplaywrightpuppeteerscraperscrapingtypescriptweb-crawlerweb-crawlingweb-scraping
Update CHANGELOG.md
petrpatek343366dd9bf9
diff --git a/CHANGELOG.md b/CHANGELOG.mdindex bfe5865f9..1a4f4f4a8 100644--- a/CHANGELOG.md+++ b/CHANGELOG.md@@ -2,6 +2,7 @@ NEXT====================- **BREAKING** `CheerioCrawler` ignores ssl errors by default - `options.ignoreSslErrors: true`.- Add `SessionPool` implemenation to `CheerioCrawler`.+- Add `SessionPool` implementation to `PuppeteerPool` and `PupeteerCrawler`.- Fix `Request` constructor not making a copy of objects such as `userData` and `headers`.- Fix `desc` option not being applied in local `dataset.getData()`.