Skip to content

Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.

Updated docs

Jan Curn60cc23fa61d0
diff --git a/src/puppeteer_crawler.js b/src/puppeteer_crawler.js
index 01990d883..47c420952 100644
--- a/src/puppeteer_crawler.js
+++ b/src/puppeteer_crawler.js
@@ -121,9 +121,9 @@ const DEFAULT_OPTIONS = {
*
* Note that a single page object is only used to process a single request and it is closed afterwards.
*
- * See source code on
- * <a href="https://github.com/apifytech/apify-js/blob/master/src/puppeteer_crawler.js#L9" target="_blank">GitHub</a>
- * for default behavior.
+ * By default, the function invokes Puppeteer's `Page.goto()` with a timeout of 60 seconds.
+ * For details, see source code on
+ * <a href="https://github.com/apifytech/apify-js/blob/master/src/puppeteer_crawler.js#L9" target="_blank">GitHub</a>.
* @param {Function} [options.handleFailedRequestFunction]
* A function to handle requests that failed more than `option.maxRequestRetries` times.
*