Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.
TypeScript apifyautomationcrawlercrawlingheadlessheadless-chromejavascriptnodejsnpmplaywrightpuppeteerscraperscrapingtypescriptweb-crawlerweb-crawlingweb-scraping
Merging develop
Marek Trunkat9bc5764623bd
diff --cc CHANGELOG.mdindex 52fd06ce3,65152b263..1d39d0495--- a/CHANGELOG.md+++ b/CHANGELOG.md@@@ -1,6 -1,6 +1,7 @@@- 0.5.44 / 2018-07-20-xxx++0.5.47 / 2018-07-20===================-- Removed `pageCloseTimeoutMillis` option from `PuppeteerCrawler` since it only affects debug logging+- Puppeteer updated to v1.6.0.++- Removed `pageCloseTimeoutMillis` option from `PuppeteerCrawler` since it only affects debug logging.0.5.43 / 2018-07-18===================diff --cc package.jsonindex 6beb431a8,79084d335..9f81a23bc--- a/package.json+++ b/package.json@@@ -1,6 -1,6 +1,6 @@@{"name": "apify",-- "version": "0.5.46",++ "version": "0.5.47","description": "Web scraping and automation SDK","main": "build/index.js","keywords": [