Skip to content

Supercharge your AI agents with data from the web and beyond. Building the library for superintelligence. 🔥

fix(queue-jobs): never cc timeout jobs that are crawl-associated (makes no sense)

Gergő Móricz0f325001499f
diff --git a/apps/api/src/services/queue-jobs.ts b/apps/api/src/services/queue-jobs.ts
index f2ecb28e0..2a08de6c8 100644
--- a/apps/api/src/services/queue-jobs.ts
+++ b/apps/api/src/services/queue-jobs.ts
@@ -46,7 +46,7 @@ async function _addScrapeJobToConcurrencyQueue(
jobId: jobId,
},
priority: jobPriority,
- }, webScraperOptions.scrapeOptions?.timeout ?? (60 * 1000));
+ }, webScraperOptions.crawl_id ? Infinity :(webScraperOptions.scrapeOptions?.timeout ?? (60 * 1000)));
}
async function _addCrawlScrapeJobToConcurrencyQueue(