Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.
TypeScript apifyautomationcrawlercrawlingheadlessheadless-chromejavascriptnodejsnpmplaywrightpuppeteerscraperscrapingtypescriptweb-crawlerweb-crawlingweb-scraping
fix: add `Request.maxRetries` to the `RequestOptions` interface (#2024)
Martin Adámek6433821a5953
diff --git a/packages/core/src/request.ts b/packages/core/src/request.tsindex 7ef2b97fd..675c53a1c 100644--- a/packages/core/src/request.ts+++ b/packages/core/src/request.ts@@ -174,7 +174,6 @@ export class Request<UserData extends Dictionary = Dictionary> {loadedUrl?: string;retryCount?: number;sessionRotationCount?: number;- maxRetries?: number;errorMessages?: string[];handledAt?: string | Date;};@@ -469,6 +468,11 @@ export interface RequestOptions<UserData extends Dictionary = Dictionary> {*/skipNavigation?: boolean;+ /**+ * Maximum number of retries for this request. Allows to override the global `maxRequestRetries` option of `BasicCrawler`.+ */+ maxRetries?: number;+/** @internal */id?: string;