Skip to content

Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.

Increment version, update changelog

Ondra Urbanf6e6dc5e96ab
diff --git a/CHANGELOG.md b/CHANGELOG.md
index 3f8449ffc..f3daa0538 100644
--- a/CHANGELOG.md
+++ b/CHANGELOG.md
@@ -1,4 +1,4 @@
-xxx
+0.10.0 / 2018-12-19
===================
- `autoscaledPool.isFinishedFunction()` and `autoscaledPool.isTaskReadyFunction()` exceptions
will now cause the `Promise` returned by `autoscaledPool.run()` to reject instead of just
@@ -6,10 +6,12 @@ xxx
- Bugfix: PuppeteerPool was incorrectly overriding `proxyUrls` even if they were not defined.
- Fixed an issue where an error would be thrown when `datasetLocal.getData()` was invoked
with an overflowing offset. It now correctly returns an empty `Array`.
-- Added the `reusePages` option to `PuppeteerPool`. It will now reuse existing tabs by default
- instead of opening new ones for each page.
+- Added the `reusePages` option to `PuppeteerPool`. It will now reuse existing tabs
+ instead of opening new ones for each page when enabled.
- `BasicCrawler` (and therefore all Crawlers) now logs a message explaining why it finished.
- Fixed an issue where `maxRequestsPerCrawl` option would not be honored after restart or migration.
+- Fixed an issue with timeout promises that would sometimes keep the process hanging.
+- `CheerioCrawler` now accepts `gzip` and `deflate` compressed responses.
0.9.15 / 2018-11-30
===================
diff --git a/package.json b/package.json
index 5921da104..b66352053 100644
--- a/package.json
+++ b/package.json
@@ -1,6 +1,6 @@
{
"name": "apify",
- "version": "0.9.15",
+ "version": "0.10.0",
"description": "The scalable web crawling and scraping library for JavaScript. Enables development of data extraction and web automation jobs (not only) with headless Chrome and Puppeteer.",
"engines": {
"node": ">=8.0.0"