Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.
TypeScript apifyautomationcrawlercrawlingheadlessheadless-chromejavascriptnodejsnpmplaywrightpuppeteerscraperscrapingtypescriptweb-crawlerweb-crawlingweb-scraping
Updated docs
Jan Curn48455097c62a
diff --git a/src/puppeteer_crawler.js b/src/puppeteer_crawler.jsindex 570978452..8328922f7 100644--- a/src/puppeteer_crawler.js+++ b/src/puppeteer_crawler.js@@ -116,7 +116,7 @@ const PAGE_CLOSE_TIMEOUT_MILLIS = 30000;* See source code on <a href="https://github.com/apifytech/apify-js/blob/master/src/puppeteer_crawler.js#L9">GitHub</a> for default behavior.* @param {LaunchPuppeteerOptions} [options.launchPuppeteerOptions]* Options used by `Apify.launchPuppeteer()` to start new Puppeteer instances.- * See `launchPuppeteerOptions` parameter of `PuppeteerPool`.+ * See `launchPuppeteerOptions` parameter of {@linkcode PuppeteerPool}'s constructor.* @param {Object} [options.autoscaledPoolOptions]* Custom options passed to the underlying {@link AutoscaledPool|`AutoscaledPool`} instance constructor.* Note that the `runTaskFunction`, `isTaskReadyFunction` and `isFinishedFunction` options