Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.
TypeScript apifyautomationcrawlercrawlingheadlessheadless-chromejavascriptnodejsnpmplaywrightpuppeteerscraperscrapingtypescriptweb-crawlerweb-crawlingweb-scraping
Upgraded apify-client to 0.5.22
Jan Curnd877b1fd33ed
diff --git a/CHANGELOG.md b/CHANGELOG.mdindex c89c7a821..a1ecca4de 100644--- a/CHANGELOG.md+++ b/CHANGELOG.md@@ -2,6 +2,7 @@ xxx====================- Bugfix in BasicCrawler: async calls in `isFinishedFunction` were not awaited- Better logging of memory overload errors+- Upgraded `apify-client` to 0.5.220.14.15 / 2019-05-31====================diff --git a/package.json b/package.jsonindex e6199c878..1f3f65d13 100644--- a/package.json+++ b/package.json@@ -50,7 +50,7 @@},"dependencies": {"@apify/ps-tree": "^1.1.3",- "apify-client": "^0.5.19",+ "apify-client": "^0.5.22","apify-shared": "^0.1.51","cheerio": "^1.0.0-rc.2","content-type": "^1.0.4",