Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.
TypeScript apifyautomationcrawlercrawlingheadlessheadless-chromejavascriptnodejsnpmplaywrightpuppeteerscraperscrapingtypescriptweb-crawlerweb-crawlingweb-scraping
Add final beta of new client
Ondra Urban13ca8c8361ac
diff --git a/CHANGELOG.md b/CHANGELOG.mdindex 4edb3cc16..eaa02ebf0 100644--- a/CHANGELOG.md+++ b/CHANGELOG.md@@ -1,12 +1,19 @@0.22.0 / XXX====================+This is the last major release before SDK v1.0.0. We're committed to deliver v1 at the+end of 2020 so stay tuned. Besides Playwright integration via a new `BrowserPool`,+it will be the first release of SDK that we'll support for an extended period of time.+We will not make any breaking changes until 2.0.0, which will come at the end of+2021. But enough about v1, let's see the changes in 0.22.0.+In this release we've changed a lot of code, but you may not even notice.We've updated the underlying `apify-client` package which powers all communication withthe Apify API to version `1.0.0`. This means a completely new API for all internal calls.If you use `Apify.client` calls in your code, this will be a large breaking change for you.-Visit the client docs for a migration guide. <----- TODO+Visit the [client docs](https://github.com/apify/apify-client-js/blob/master/README.md)+to see what's new.-Until now, local emulation of Apify Storages was part of the SDK. We've moved the logic+Until now, local emulation of Apify Storages has been a part of the SDK. We moved the logicinto a separate package `@apify/storage-local` which shares interface with `apify-client`.`RequestQueue` is now powered by `SQLite3` instead of file system, which improvesreliability and performance quite a bit. `Dataset` and `KeyValueStore` still use filediff --git a/package.json b/package.jsonindex b45723960..68b84bb8e 100644--- a/package.json+++ b/package.json@@ -60,7 +60,7 @@"@types/puppeteer": "^5.4.0","@types/socket.io": "^2.1.11","@types/tough-cookie": "^4.0.0",- "apify-client": "1.0.0-beta.12",+ "apify-client": "1.0.0-beta.14","apify-shared": "^0.5.0","cheerio": "^1.0.0-rc.3","content-type": "^1.0.4",