Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.
TypeScript apifyautomationcrawlercrawlingheadlessheadless-chromejavascriptnodejsnpmplaywrightpuppeteerscraperscrapingtypescriptweb-crawlerweb-crawlingweb-scraping
Removed --enable-resource-load-scheduler=false Chrome command line flag
Jan Curn70ddee4f10d7
diff --git a/CHANGELOG.md b/CHANGELOG.mdindex ced912394..ed6eb7624 100644--- a/CHANGELOG.md+++ b/CHANGELOG.md@@ -1,3 +1,8 @@+xxx+===================+- Removed `--enable-resource-load-scheduler=false` Chromium command line flag, it has no effect.+ See https://bugs.chromium.org/p/chromium/issues/detail?id=723233+0.14.0 / 2019-04-15===================- **BREAKING CHANGE:** Live View is no longer available by passing `liveView = true` to `launchPuppeteerOptions`.diff --git a/docs/api/Apify.md b/docs/api/Apify.mdindex 5d6fcdadb..a9f633d71 100644--- a/docs/api/Apify.md+++ b/docs/api/Apify.md@@ -558,8 +558,6 @@ The `launchPuppeteer()` function alters the following Puppeteer options:<li>The function adds <code>--no-sandbox</code> to <code>args</code> to enable runningheadless Chrome in a Docker container on the Apify platform.- Also it adds <code>--enable-resource-load-scheduler=false</code>- to make crawling of pages in all tabs run equally fast.</li><li>Sets <code>defaultViewport</code> Puppeteer option (if not already set)diff --git a/src/puppeteer.js b/src/puppeteer.jsindex e231044f9..b89399e24 100644--- a/src/puppeteer.js+++ b/src/puppeteer.js@@ -152,8 +152,6 @@ const getPuppeteerOrThrow = (puppeteerModule = 'puppeteer') => {* <li>* The function adds <code>--no-sandbox</code> to <code>args</code> to enable running* headless Chrome in a Docker container on the Apify platform.- * Also it adds <code>--enable-resource-load-scheduler=false</code>- * to make crawling of pages in all tabs run equally fast.* </li>* <li>* Sets <code>defaultViewport</code> Puppeteer option (if not already set)@@ -201,8 +199,6 @@ export const launchPuppeteer = async (options = {}) => {optsCopy.args = optsCopy.args || [];optsCopy.args.push('--no-sandbox');- // TODO: It's not clear that this works, keep eye on https://bugs.chromium.org/p/chromium/issues/detail?id=723233- optsCopy.args.push('--enable-resource-load-scheduler=false');if (optsCopy.headless == null) {optsCopy.headless = process.env[ENV_VARS.HEADLESS] === '1' && process.env[ENV_VARS.XVFB] !== '1';}