Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.
TypeScript apifyautomationcrawlercrawlingheadlessheadless-chromejavascriptnodejsnpmplaywrightpuppeteerscraperscrapingtypescriptweb-crawlerweb-crawlingweb-scraping
Bump version, update changelog
Ondra Urban6473c282f58c
diff --git a/CHANGELOG.md b/CHANGELOG.mdindex 4300e02cc..7c29ccb94 100644--- a/CHANGELOG.md+++ b/CHANGELOG.md@@ -1,4 +1,22 @@-NEXT+0.21.0 / NEXT+====================+This release comes with a redesigned proxy configuration. All crawlers now accept+a `proxyConfiguration` parameter, which is an instance of `ProxyConfiguration`.+Apify Proxy is now exclusively serviced by this class. In the next release,+custom proxy management will move to `ProxyConfiguration` as well.++- **BREAKING:** Removed `Apify.getApifyProxyUrl()`. To get an Apify Proxy url,+ use `proxyConfiguration.getUrl([sessionId])`.+- **BREAKING:** Removed `useApifyProxy`, `apifyProxyGroups` and `apifyProxySession` parameters+ from all applications in the SDK. Use `proxyConfiguration` in crawlers and `proxyUrl`+ in `requestAsBrowser` and `Apify.launchPuppeteer`.+- Add `Apify.createProxyConfiguration()` `async` function to create `ProxyConfiguration`+ instances. `ProxyConfiguration` itself is not exposed.+- Add `proxyConfiguration` to `BasicCrawlerOptions`, `CheerioCrawlerOptions`+ and `PuppeteerCrawlerOptions`.+++0.20.4 / 2020-05-11====================- Add `Apify.utils.waitForRunToFinish()` which simplifies waiting for an actor run to finish.- Add standard prefixes to log messages to improve readability and orientation in logs.@@ -7,6 +25,7 @@ NEXTto the crawler to modify its behavior. A plugin that extends functionality.- Fix bug with cookie expiry in `SessionPool`.- Fix issues in documentation.+- Updated `@apify/http-request` to fix issue in the `proxy-agent` package.- Updated Puppeteer to 3.0.2diff --git a/package.json b/package.jsonindex 709946dfb..d032ae0e1 100644--- a/package.json+++ b/package.json@@ -1,6 +1,6 @@{"name": "apify",- "version": "0.20.4",+ "version": "0.21.0","description": "The scalable web crawling and scraping library for JavaScript/Node.js. Enables development of data extraction and web automation jobs (not only) with headless Chrome and Puppeteer.","engines": {"node": "^10.17.0 || ^12.3.0"