Skip to content

Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.

Better log message

Jan Curn1cbcd740a39c
diff --git a/src/puppeteer_crawler.js b/src/puppeteer_crawler.js
index a5824246f..4f6d6c26a 100644
--- a/src/puppeteer_crawler.js
+++ b/src/puppeteer_crawler.js
@@ -224,7 +224,7 @@ class PuppeteerCrawler {
proxyUrls,
};
Object.entries(deprecatedPuppeteerPoolOptions).forEach(([key, value]) => {
- if (value) log.deprecated(`PuppeteerCrawler: options.${key} is deprecated. Use options.puppeteerPoolOptions instead.`);
+ if (value) log.deprecated(`PuppeteerCrawler: "options.${key}" is deprecated, use "options.puppeteerPoolOptions" in PuppeteerCrawler() constructor instead.`); // eslint-disable-line max-len
});
// puppeteerPoolOptions can be null or undefined or Object, so we merge it this way, because null is not replaced by defaults above.
this.puppeteerPoolOptions = _.defaults(