Skip to content

Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.

docs: fix extra property [skip ci]

Ondra Urban90b1881f47ca
diff --git a/src/crawlers/playwright_crawler.js b/src/crawlers/playwright_crawler.js
index 1f407cac6..6a9c37581 100644
--- a/src/crawlers/playwright_crawler.js
+++ b/src/crawlers/playwright_crawler.js
@@ -148,8 +148,6 @@ import { gotoExtended } from '../playwright_utils';
* @property {RequestQueue} [requestQueue]
* Dynamic queue of URLs to be processed. This is useful for recursive crawling of websites.
* Either `requestList` or `requestQueue` option must be provided (or both).
- * @property {number} [handleRequestTimeoutSecs=60]
- * Timeout in which the function passed as `handleRequestFunction` needs to finish, in seconds.
* @property {number} [maxRequestRetries=3]
* Indicates how many times the request is retried if {@link PlaywrightCrawlerOptions.handlePageFunction} fails.
* @property {number} [maxRequestsPerCrawl]
diff --git a/src/crawlers/puppeteer_crawler.js b/src/crawlers/puppeteer_crawler.js
index d83f4ee66..48b692d3b 100644
--- a/src/crawlers/puppeteer_crawler.js
+++ b/src/crawlers/puppeteer_crawler.js
@@ -136,8 +136,6 @@ import { BrowserPoolOptions } from 'browser-pool';
* @property {RequestQueue} [requestQueue]
* Dynamic queue of URLs to be processed. This is useful for recursive crawling of websites.
* Either `requestList` or `requestQueue` option must be provided (or both).
- * @property {number} [handleRequestTimeoutSecs=60]
- * Timeout in which the function passed as `handleRequestFunction` needs to finish, in seconds.
* @property {number} [maxRequestRetries=3]
* Indicates how many times the request is retried if {@link PuppeteerCrawlerOptions.handlePageFunction} fails.
* @property {number} [maxRequestsPerCrawl]
@@ -147,7 +145,7 @@ import { BrowserPoolOptions } from 'browser-pool';
* @property {AutoscaledPoolOptions} [autoscaledPoolOptions]
* Custom options passed to the underlying {@link AutoscaledPool} constructor.
* Note that the `runTaskFunction` and `isTaskReadyFunction` options
- * are provided by `BasicCrawler` and cannot be overridden.
+ * are provided by the crawler and cannot be overridden.
* However, you can provide a custom implementation of `isFinishedFunction`.
* @property {number} [minConcurrency=1]
* Sets the minimum concurrency (parallelism) for the crawl. Shortcut to the corresponding {@link AutoscaledPool} option.