Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.
TypeScript apifyautomationcrawlercrawlingheadlessheadless-chromejavascriptnodejsnpmplaywrightpuppeteerscraperscrapingtypescriptweb-crawlerweb-crawlingweb-scraping
Dropped support for Node 7
Jan Curn5f7aefa5b505
diff --git a/.babelrc b/.babelrcindex aa2553aea..9d0e8d967 100644--- a/.babelrc+++ b/.babelrc@@ -2,7 +2,7 @@"presets": [["babel-preset-env", {"targets": {- "node": "7.0.0"+ "node": "8.0.0"}}]]diff --git a/.travis.yml b/.travis.ymlindex 52523fd5e..fa10766fc 100644--- a/.travis.yml+++ b/.travis.yml@@ -17,7 +17,6 @@ node_js:- "10"- "9"- "8"- - "7"script:- npm run lint- npm testdiff --git a/CHANGELOG.md b/CHANGELOG.mdindex 4b71c83fd..bde794cee 100644--- a/CHANGELOG.md+++ b/CHANGELOG.md@@ -6,6 +6,7 @@ xxx- More efficient implementation of `getMemoryInfo` function- Puppeteer upgraded to 1.7.0- Upgraded NPM dependencies+- Dropped support for Node 70.5.51 / 2018-08-09===================diff --git a/package.json b/package.jsonindex da7ed78d1..aaec81118 100644--- a/package.json+++ b/package.json@@ -3,6 +3,9 @@"version": "0.5.51","description": "Web scraping and automation SDK","main": "build/index.js",+ "engines": {+ "node": ">=8.0.0"+ },"keywords": ["apify","headless",