Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.
TypeScript apifyautomationcrawlercrawlingheadlessheadless-chromejavascriptnodejsnpmplaywrightpuppeteerscraperscrapingtypescriptweb-crawlerweb-crawlingweb-scraping
Updated docs
Jan Curnaef2ed6e2f35
diff --git a/src/request_queue.js b/src/request_queue.jsindex eff12bf37..e617cd020 100644--- a/src/request_queue.js+++ b/src/request_queue.js@@ -349,8 +349,9 @@ export class RequestQueue {}/**- * Reclaims failed request back to the queue,- * so that it can be processed later again.+ * Reclaims failed request back to the queue, so that it can be processed later again.+ * The request record in the queue is updated using the provided `request` parameter.+ * For example, this lets you store the number of retries for the request.** @param {Request} request* @param {Object} [options]