Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.
TypeScript apifyautomationcrawlercrawlingheadlessheadless-chromejavascriptnodejsnpmplaywrightpuppeteerscraperscrapingtypescriptweb-crawlerweb-crawlingweb-scraping
Update Node restrictions to 10.17.0
Ondra Urban2f5796439d8b
diff --git a/.babelrc b/.babelrcindex 3f77b8750..64e62a5e9 100644--- a/.babelrc+++ b/.babelrc@@ -2,7 +2,7 @@"presets": [["@babel/preset-env", {"targets": {- "node": "8.14.0"+ "node": "10.17.0"}}]]diff --git a/CHANGELOG.md b/CHANGELOG.mdindex eaef4ad25..f0557c798 100644--- a/CHANGELOG.md+++ b/CHANGELOG.md@@ -1,5 +1,6 @@NEXT====================+- **BREAKING**: Node 8 and 9 are no longer supported. Please use Node 10.17.0 or higher.- **DEPRECATED**: `Apify.callTask()` `body` and `contentType` options are now deprecated.Use `input` instead. It must be of `content-type: application/json`.- Add default `SessionPool` implementation to `BasicCrawler`.diff --git a/package.json b/package.jsonindex 6a6271a31..2949dae46 100644--- a/package.json+++ b/package.json@@ -3,7 +3,7 @@"version": "0.16.2","description": "The scalable web crawling and scraping library for JavaScript/Node.js. Enables development of data extraction and web automation jobs (not only) with headless Chrome and Puppeteer.","engines": {- "node": ">=8.14.0"+ "node": ">=10.17.0"},"main": "build/index.js","keywords": [