Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.
TypeScript apifyautomationcrawlercrawlingheadlessheadless-chromejavascriptnodejsnpmplaywrightpuppeteerscraperscrapingtypescriptweb-crawlerweb-crawlingweb-scraping
Improve link in comment
Ondra Urban139f8fdbace4
diff --git a/src/request_list.js b/src/request_list.jsindex 2dbc18158..fcf459818 100644--- a/src/request_list.js+++ b/src/request_list.js@@ -62,8 +62,8 @@ const ensureUniqueKeyValid = (uniqueKey) => {* @param {Object} options* @param {Array} options.sources An array of sources for the `RequestList`. Its contents can either be just plain objects,* defining at least the 'url' property, or instances of the `Request` class. See the- * <a href="https://www.apify.com/docs/sdk/apify-runtime-js/latest#Request">Request class documentation</a>- * for available properties. Additionally a `requestsFromUrl` property may be used instead of `url`,+ * <a href="#Request">Request class documentation</a> for available properties.+ * Additionally a `requestsFromUrl` property may be used instead of `url`,* which will instruct the `RequestList` to download the sources from the given URL.* URLs will be parsed from the received response.* ```javascript