Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.
TypeScript apifyautomationcrawlercrawlingheadlessheadless-chromejavascriptnodejsnpmplaywrightpuppeteerscraperscrapingtypescriptweb-crawlerweb-crawlingweb-scraping
Fix and build docs [skip ci]
Ondra Urban7be9cecc652a
diff --git a/docs/api/Apify.md b/docs/api/Apify.mdindex b19ac7357..e6988c1e8 100644--- a/docs/api/Apify.md+++ b/docs/api/Apify.md@@ -23,7 +23,7 @@ accessible from the left sidebar.* [`.isAtHome()`](#module_Apify.isAtHome) ⇒ `Boolean`* [`.launchPuppeteer([options])`](#module_Apify.launchPuppeteer) ⇒ `Promise<Browser>`* [`.main(userFunc)`](#module_Apify.main)- * [`.metamorph(targetActorId, [input], [options])`](#module_Apify.metamorph) ⇒ `Promise<undefined>`+ * [`.metamorph(targetActorId, [input], [options])`](#module_Apify.metamorph) ⇒ `Promise`* [`.openDataset([datasetIdOrName], [options])`](#module_Apify.openDataset) ⇒ [`Promise<Dataset>`](dataset)* [`.openKeyValueStore([storeIdOrName], [options])`](#module_Apify.openKeyValueStore) ⇒ [`Promise<KeyValueStore>`](keyvaluestore)* [`.openRequestList`](#module_Apify.openRequestList) ⇒ [`Promise<RequestList>`](requestlist)@@ -696,7 +696,7 @@ the promise will be awaited. The user function is called with no arguments.</p></table><a name="module_Apify.metamorph"></a>-## `Apify.metamorph(targetActorId, [input], [options])` ⇒ `Promise<undefined>`+## `Apify.metamorph(targetActorId, [input], [options])` ⇒ `Promise`Transforms this actor run to an actor run of a given actor. The system stops the current container and starts the new containerinstead. All the default storages are preserved and the new input is stored under the `INPUT-METAMORPH-1` key in the same default key-value store.diff --git a/docs/api/puppeteer.md b/docs/api/puppeteer.mdindex c1295e6f7..150326a46 100644--- a/docs/api/puppeteer.md+++ b/docs/api/puppeteer.md@@ -49,14 +49,14 @@ If you're looking to find URLs in `href` attributes of the page, see [`enqueueLiOptionally, the function allows you to filter the target links' URLs using an array of [`PseudoUrl`](pseudourl) objectsand override settings of the enqueued [`Request`](request) objects.-*IMPORTANT*: To be able to do this, this function uses various mutations on the page,+**IMPORTANT**: To be able to do this, this function uses various mutations on the page,such as changing the Z-index of elements being clicked and their visibility. Therefore,it is recommended to only use this function as the last operation in the page.-*USING HEADFUL BROWSER*: When using a headful browser, this function will only be able to click elements+**USING HEADFUL BROWSER**: When using a headful browser, this function will only be able to click elementsin the focused tab, effectively limiting concurrency to 1. In headless mode, full concurrency can be achieved.-*PERFORMANCE*: Clicking elements with a mouse and intercepting requests is not a low level operation+**PERFORMANCE**: Clicking elements with a mouse and intercepting requests is not a low level operationthat takes nanoseconds. It's not very CPU intensive, but it takes time. We strongly recommend limitingthe scope of the clicking as much as possible by using a specific selector that targets only the elementsthat you assume or know will produce a navigation. You can certainly click everything by usingdiff --git a/docs/api/utils.md b/docs/api/utils.mdindex bf136ba22..1389cfdab 100644--- a/docs/api/utils.md+++ b/docs/api/utils.md@@ -57,7 +57,7 @@ await Apify.utils.enqueueLinks({requestQueue,selector: 'a.product-detail',pseudoUrls: [- 'https://www.example.com/handbags/[.*]'+ 'https://www.example.com/handbags/[.*]','https://www.example.com/purses/[.*]'],});diff --git a/src/actor.js b/src/actor.jsindex b76a731cf..2d292107a 100644--- a/src/actor.js+++ b/src/actor.js@@ -550,7 +550,7 @@ export const callTask = async (taskId, input, options = {}) => {* @param {String} [options.build]* Tag or number of the target actor build to metamorph into (e.g. `beta` or `1.2.345`).* If not provided, the run uses build tag or number from the default actor run configuration (typically `latest`).- * @returns {Promise<undefined>}+ * @returns {Promise}** @memberof module:Apify* @functiondiff --git a/src/enqueue_links/click_elements.js b/src/enqueue_links/click_elements.jsindex 26982058c..e505180f9 100644--- a/src/enqueue_links/click_elements.js+++ b/src/enqueue_links/click_elements.js@@ -20,14 +20,14 @@ const STARTING_Z_INDEX = 2147400000;* Optionally, the function allows you to filter the target links' URLs using an array of {@link PseudoUrl} objects* and override settings of the enqueued {@link Request} objects.*- * *IMPORTANT*: To be able to do this, this function uses various mutations on the page,+ * **IMPORTANT**: To be able to do this, this function uses various mutations on the page,* such as changing the Z-index of elements being clicked and their visibility. Therefore,* it is recommended to only use this function as the last operation in the page.*- * *USING HEADFUL BROWSER*: When using a headful browser, this function will only be able to click elements+ * **USING HEADFUL BROWSER**: When using a headful browser, this function will only be able to click elements* in the focused tab, effectively limiting concurrency to 1. In headless mode, full concurrency can be achieved.*- * *PERFORMANCE*: Clicking elements with a mouse and intercepting requests is not a low level operation+ * **PERFORMANCE**: Clicking elements with a mouse and intercepting requests is not a low level operation* that takes nanoseconds. It's not very CPU intensive, but it takes time. We strongly recommend limiting* the scope of the clicking as much as possible by using a specific selector that targets only the elements* that you assume or know will produce a navigation. You can certainly click everything by using