Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.
TypeScript apifyautomationcrawlercrawlingheadlessheadless-chromejavascriptnodejsnpmplaywrightpuppeteerscraperscrapingtypescriptweb-crawlerweb-crawlingweb-scraping
Better log message
Jan Curn1cbcd740a39c
diff --git a/src/puppeteer_crawler.js b/src/puppeteer_crawler.jsindex a5824246f..4f6d6c26a 100644--- a/src/puppeteer_crawler.js+++ b/src/puppeteer_crawler.js@@ -224,7 +224,7 @@ class PuppeteerCrawler {proxyUrls,};Object.entries(deprecatedPuppeteerPoolOptions).forEach(([key, value]) => {- if (value) log.deprecated(`PuppeteerCrawler: options.${key} is deprecated. Use options.puppeteerPoolOptions instead.`);+ if (value) log.deprecated(`PuppeteerCrawler: "options.${key}" is deprecated, use "options.puppeteerPoolOptions" in PuppeteerCrawler() constructor instead.`); // eslint-disable-line max-len});// puppeteerPoolOptions can be null or undefined or Object, so we merge it this way, because null is not replaced by defaults above.this.puppeteerPoolOptions = _.defaults(