Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.
TypeScript apifyautomationcrawlercrawlingheadlessheadless-chromejavascriptnodejsnpmplaywrightpuppeteerscraperscrapingtypescriptweb-crawlerweb-crawlingweb-scraping
Apply 0.22.4 hotfix to master (#897)
Ondra Urband87e303de41e
diff --git a/CHANGELOG.md b/CHANGELOG.mdindex 8e9582a82..234475126 100644--- a/CHANGELOG.md+++ b/CHANGELOG.md@@ -1,4 +1,4 @@-1.0.0 / 2020/01/XX+1.0.0 / 2021/01/XX====================After 3.5 years of rapid development and a lot of breaking changes and deprecations,here comes the result - **Apify SDK v1**. There were two goals for this release. **Stability**@@ -74,6 +74,14 @@ Bug fixes and scraping features will of course keep landing in versions 1.X as w- Added `browserController` to `handlePageFunction` arguments.- Added `crawler.crawlingContexts` `Map` which includes all running `crawlingContext`s.+0.22.4 / 2021/01/10+====================+- Fix issues with `Apify.pushData()` and `keyValueStore.forEachKey()`+ by updating `@apify/storage-local` to `1.0.2`.++0.22.3 / 2021/01/09+====================+- Fix `puppeteerPool` missing in handle page arguments.0.22.2 / 2020/12/22====================diff --git a/package.json b/package.jsonindex 2d29f360a..f8d72cf6d 100644--- a/package.json+++ b/package.json@@ -53,7 +53,7 @@"dependencies": {"@apify/http-request": "^2.1.1","@apify/ps-tree": "^1.1.3",- "@apify/storage-local": "1.0.1",+ "@apify/storage-local": "1.0.2","@types/cheerio": "^0.22.22","@types/domhandler": "^2.4.1","@types/node": "^14",