Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.
TypeScript apifyautomationcrawlercrawlingheadlessheadless-chromejavascriptnodejsnpmplaywrightpuppeteerscraperscrapingtypescriptweb-crawlerweb-crawlingweb-scraping
Updated changelog
drobnikj0241329eba46
diff --git a/CHANGELOG.md b/CHANGELOG.mdindex 08830b7d2..94c84ba61 100644--- a/CHANGELOG.md+++ b/CHANGELOG.md@@ -1,3 +1,7 @@+NEXT+====================+- Fixed: RequestList persist downloaded sources in key-value store+0.16.1 / 2019-10-31====================- Bump Puppeteer to 2.0.0 and use `{ pipe: true }` again because upstream bug has been fixed.