Skip to content

Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.

Updating readme

Marek Trunkatd5691e27f885
diff --git a/CHANGELOG.md b/CHANGELOG.md
index e00fc143e..0a44c3aac 100644
--- a/CHANGELOG.md
+++ b/CHANGELOG.md
@@ -1,10 +1,10 @@
0.5.23 / 2018-04-18
===================
-- **WARNING**: `disableProxy` configuration of `PuppeteerCrawler`, `BasicCrawler` and `PuppeteerPool` removed. By default no proxy is used.
+- **WARNING**: `disableProxy` configuration of `PuppeteerCrawler` and `PuppeteerPool` removed. By default no proxy is used.
You must either use new configuration `launchPuppeteerOptions.useApifyProxy = true` to use Apify Proxy or provide own proxy via
`launchPuppeteerOptions.proxyUrl`.
-- **WARNING**: `groups` parameter of `PuppeteerCrawler`, `BasicCrawler` and `PuppeteerPool` removed. Use `launchPuppeteerOptions.apifyProxyGroups` instead.
-- **WARNING**: `session` and `groups` parameters of `Apify.launchPuppeteer()` are now validated to contain only alphanumberic
+- **WARNING**: `groups` parameter of `PuppeteerCrawler` and `PuppeteerPool` removed. Use `launchPuppeteerOptions.apifyProxyGroups` instead.
+- **WARNING**: `session` and `groups` parameters of `Apify.getApifyProxyUrl()` are now validated to contain only alphanumberic
characters and underscores.
- `Apify.call()` now throws an `ApifyCallError` error if run doesn't succeed
- Renamed options `abortInstanceAfterRequestCount` of `PuppeteerPool` and `PuppeteerCrawler` to retireInstanceAfterRequestCcount