Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.
TypeScript apifyautomationcrawlercrawlingheadlessheadless-chromejavascriptnodejsnpmplaywrightpuppeteerscraperscrapingtypescriptweb-crawlerweb-crawlingweb-scraping
Increase CPU overload threshold; Bump version
Ondra Urbanb728ecdfdce8
diff --git a/CHANGELOG.md b/CHANGELOG.mdindex 74164b950..7f7f88f0a 100644--- a/CHANGELOG.md+++ b/CHANGELOG.md@@ -1,6 +1,7 @@-xxx+0.8.3 / 2018-09-22==================- Updated documentation and README.+- Optimized autoscaled pool default configuration.0.8.0 / 2018-09-19==================diff --git a/package.json b/package.jsonindex 29e913e64..46a969ea0 100644--- a/package.json+++ b/package.json@@ -1,6 +1,6 @@{"name": "apify",- "version": "0.8.2",+ "version": "0.8.3","description": "Web scraping and automation SDK","engines": {"node": ">=8.0.0"diff --git a/src/autoscaling/system_status.js b/src/autoscaling/system_status.jsindex 81b78dedd..cb1918e63 100644--- a/src/autoscaling/system_status.js+++ b/src/autoscaling/system_status.js@@ -7,7 +7,7 @@ const DEFAULT_OPTIONS = {currentHistorySecs: 5,maxMemoryOverloadedRatio: 0.2,maxEventLoopOverloadedRatio: 0.2,- maxCpuOverloadedRatio: 0.2,+ maxCpuOverloadedRatio: 0.4,};/**