Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.
TypeScript apifyautomationcrawlercrawlingheadlessheadless-chromejavascriptnodejsnpmplaywrightpuppeteerscraperscrapingtypescriptweb-crawlerweb-crawlingweb-scraping
Bump version, update changelog
Ondra Urban4fc70773b977
diff --git a/CHANGELOG.md b/CHANGELOG.mdindex 3d266f094..8629e3922 100644--- a/CHANGELOG.md+++ b/CHANGELOG.md@@ -1,10 +1,15 @@-NEXT+0.20.3 / 2020-04-14====================- **DEPRECATED:** `CheerioCrawlerOptions.requestOptions` is now deprecated. Please use`CheerioCrawlerOptions.prepareRequestFunction` instead.- Add `limit` option to `Apify.utils.enqueueLinks()` for situations when full crawls are not needed.-- Add `responseEncoding` option to `CheerioCrawler` to allow users to provide a fall-back- (or forced) encoding of responses in situations where websites serve invalid encoding info.+- Add `suggestResponseEncoding` and `forceResponseEncoding` options to `CheerioCrawler` to allow+ users to provide a fall-back or forced encoding of responses in situations where websites+ serve invalid encoding information in their headers.+- Add a number of new examples and update existing ones to documentation.+- Fix duplicate file extensions in `Apify.utils.puppeteer.saveSnapshot()` when used locally.+- Fix encoding of multi-byte characters in `CheerioCrawler`.+- Fix formatting of navigation buttons in documentation.0.20.2 / 2020-03-09====================diff --git a/package.json b/package.jsonindex 5653a7f78..dc49f23eb 100644--- a/package.json+++ b/package.json@@ -1,6 +1,6 @@{"name": "apify",- "version": "0.20.3",+ "version": "0.20.4","description": "The scalable web crawling and scraping library for JavaScript/Node.js. Enables development of data extraction and web automation jobs (not only) with headless Chrome and Puppeteer.","engines": {"node": "^10.17.0 || ^12.3.0"