Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.
TypeScript apifyautomationcrawlercrawlingheadlessheadless-chromejavascriptnodejsnpmplaywrightpuppeteerscraperscrapingtypescriptweb-crawlerweb-crawlingweb-scraping
Update basic_crawler.js
Marek Trunkát42e6ede14697
diff --git a/src/basic_crawler.js b/src/basic_crawler.jsindex daaacfd28..619679ad5 100644--- a/src/basic_crawler.js+++ b/src/basic_crawler.js@@ -80,7 +80,7 @@ const DEFAULT_OPTIONS = {* The function must return a promise.* @param {RequestList} options.requestList* Static list of URLs to be processed.- * Either RequestList or RequestQueue must be provided.+ * Either `RequestList` or `RequestQueue` must be provided.* @param {RequestQueue} options.requestQueue* Dynamic queue of URLs to be processed. This is useful for recursive crawling of websites.* Either RequestList or RequestQueue must be provided.