Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.
TypeScript apifyautomationcrawlercrawlingheadlessheadless-chromejavascriptnodejsnpmplaywrightpuppeteerscraperscrapingtypescriptweb-crawlerweb-crawlingweb-scraping
Update changelog, bump version
Ondra Urban85ee62a61133
diff --git a/CHANGELOG.md b/CHANGELOG.mdindex 27596d21d..192bb6bfd 100644--- a/CHANGELOG.md+++ b/CHANGELOG.md@@ -1,8 +1,12 @@-0.21.7 / 2020/09/03+0.21.8 / 2020/10/07====================- Fix an error in `PuppeteerCrawler` caused by `page.goto()` randomly returning `null`.-0.21.6 / 2020/09/02+0.21.7 / 2020/10/03+====================+- Fix an error in `PuppeteerCrawler` caused by `page.goto()` randomly returning `null`.++0.21.6 / 2020/10/02====================It appears that `CheerioCrawler` was correctly retiring sessions on timeoutsand blocked status codes (401, 403, 429), whereas `PuppeteerCrawler` did not.diff --git a/package.json b/package.jsonindex d282320da..ab31699ef 100644--- a/package.json+++ b/package.json@@ -1,6 +1,6 @@{"name": "apify",- "version": "0.21.7",+ "version": "0.21.8","description": "The scalable web crawling and scraping library for JavaScript/Node.js. Enables development of data extraction and web automation jobs (not only) with headless Chrome and Puppeteer.","engines": {"node": "^10.17.0 || ^12.3.0"