Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.
TypeScript apifyautomationcrawlercrawlingheadlessheadless-chromejavascriptnodejsnpmplaywrightpuppeteerscraperscrapingtypescriptweb-crawlerweb-crawlingweb-scraping
Update changelog; updage apify-shared
Ondra Urban2c5a8ea928fc
diff --git a/CHANGELOG.md b/CHANGELOG.mdindex df006c499..6de8ffb55 100644--- a/CHANGELOG.md+++ b/CHANGELOG.md@@ -1,4 +1,4 @@-xxxxxxxxxxxxxxxxxxx+0.6.2 / 2018-08-23===================- Added `getInfo()` method to Dataset to get meta-information about a dataset.- Added CheerioCrawler, a specialized class for crawling the web using `cheerio`.diff --git a/package.json b/package.jsonindex 835b6e968..bc8b6361c 100644--- a/package.json+++ b/package.json@@ -49,7 +49,7 @@},"dependencies": {"apify-client": "^0.2.9",- "apify-shared": "0.0.49",+ "apify-shared": "0.0.50","bluebird": "^3.5.0","content-type": "^1.0.3","fs-extra": "^7.0.0",