Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.
TypeScript apifyautomationcrawlercrawlingheadlessheadless-chromejavascriptnodejsnpmplaywrightpuppeteerscraperscrapingtypescriptweb-crawlerweb-crawlingweb-scraping
bumped version. Added ignoreSslErrors to CHANGELOG.md.
Petr Patekee6db9840b0d
diff --git a/CHANGELOG.md b/CHANGELOG.mdindex ea3dcdd43..e88ac0dd0 100644--- a/CHANGELOG.md+++ b/CHANGELOG.md@@ -4,6 +4,10 @@ NEXT- Fix `Request` constructor not making a copy of objects such as `userData` and `headers`.- Fix `desc` option not being applied in local `dataset.getData()`.+0.18.0 / 2019-12-20+====================+- **BREAKING** `CheerioCrawler` ignores ssl errors by default - `options.ignoreSslErrors: true`.+0.17.0 / 2019-11-25====================- **BREAKING**: Node 8 and 9 are no longer supported. Please use Node 10.17.0 or higher.diff --git a/package.json b/package.jsonindex f4db6e405..c75d0e49c 100644--- a/package.json+++ b/package.json@@ -1,6 +1,6 @@{"name": "apify",- "version": "0.17.1",+ "version": "0.18.0","description": "The scalable web crawling and scraping library for JavaScript/Node.js. Enables development of data extraction and web automation jobs (not only) with headless Chrome and Puppeteer.","engines": {"node": ">=10.17.0"