Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.
TypeScript apifyautomationcrawlercrawlingheadlessheadless-chromejavascriptnodejsnpmplaywrightpuppeteerscraperscrapingtypescriptweb-crawlerweb-crawlingweb-scraping
Updating changelog
Marek Trunkatfdbe083cee13
diff --git a/CHANGELOG.md b/CHANGELOG.mdindex aadba345b..6b62eb7b8 100644--- a/CHANGELOG.md+++ b/CHANGELOG.md@@ -4,6 +4,8 @@- Added `memory` parameter to `Apify.call()`.- Added `PuppeteerPool.retire(browser)` method allowing retire a browser before it reaches his limits. This isusefull when its IP address got blocked by anti-scraping protection.+- Added option `liveView: true` to `Apify.launchPuppeteer()` that will start a live view server proving web page+ with overview of all running Puppeteer instances and their screenshots.0.5.42 / 2018-07-04===================