Skip to content

Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.

Updating changelog

Marek Trunkat84435a4bfe56
diff --git a/CHANGELOG.md b/CHANGELOG.md
index bc2602875..3cff79242 100644
--- a/CHANGELOG.md
+++ b/CHANGELOG.md
@@ -1,27 +1,29 @@
-0.5.11 / 2018-03-09
+0.5.14 / 2018-03-09
===================
-- Added back --no-sandbox to launch of Puppeteer to avoid issues on older kernels
+- Added back `--no-sandbox` to launch of Puppeteer to avoid issues on older kernels
+- Added `finishWhenEmpty` and `maybeRunPromiseIntervalMillis` options to `AutoscaledPool` class.
+- Fixed false positive errors logged by `PuppeteerPool` class.
0.5.10 / 2018-03-09
===================
-- If the `APIFY_XVFB` env var is set to '1', then avoid headless mode and use Xvfb instead
+- If the `APIFY_XVFB` env var is set to `1`, then avoid headless mode and use Xvfb instead
- Updated DEFAULT_USER_AGENT to Linux Chrome
-- Consolidated startup options for Chrome - use --disable-dev-shm-usage, skip --no-sandbox,
- use --disable-gpu only on Windows
+- Consolidated startup options for Chrome - use `--disable-dev-shm-usage`, skip `--no-sandbox`,
+ use `--disable-gpu` only on Windows
- Updated docs and package description
0.5.8 / 2018-03-06
==================
-- Puppeteer updated to 1.1.1
+- Puppeteer updated to `1.1.1`
0.5.7 / 2018-03-06
==================
-- A lot of new stuff. Everything is backwards compatible. Check https://www-securitybyobscurity.apify.com/docs/sdk/apify-runtime-js/latest for reference
+- A lot of new stuff. Everything is backwards compatible. Check https://www.apify.com/docs/sdk/apify-runtime-js/latest for reference
0.5.0 / 2018-02-08
===================
-- Apify.setPromiseDependency / Apify.getPromiseDependency / Apify.getPromisePrototype removed
-- Bunch of classes as AutoscaledPool or PuppeteerCrawler added, check documentation
+- `Apify.setPromiseDependency()` / `Apify.getPromiseDependency()` / `Apify.getPromisePrototype()` removed
+- Bunch of classes as `AutoscaledPool` or `PuppeteerCrawler` added, check documentation
0.4.48 / 2018-02-05
===================
@@ -37,11 +39,11 @@
0.4.45 / 2018-01-31
===================
-- Apify.pushData() added
+- `Apify.pushData()` added
0.4.43 / 2018-01-29
===================
-- Upgraded puppeteer optional dependency to version ^1.0.0
+- Upgraded puppeteer optional dependency to version `^1.0.0`
0.0.x / 2017-01-01
==================