Supercharge your AI agents with data from the web and beyond. Building the library for superintelligence. 🔥
TypeScript aiai-agentsai-crawlerai-scrapingai-searchcrawlerdata-extractionhtml-to-markdownllmmarkdownscraperscrapingweb-crawlerweb-dataweb-data-extractionweb-scraperweb-scrapingweb-searchwebscraping
fix(queue-jobs): never cc timeout jobs that are crawl-associated (makes no sense)
Gergő Móricz0f325001499f
diff --git a/apps/api/src/services/queue-jobs.ts b/apps/api/src/services/queue-jobs.tsindex f2ecb28e0..2a08de6c8 100644--- a/apps/api/src/services/queue-jobs.ts+++ b/apps/api/src/services/queue-jobs.ts@@ -46,7 +46,7 @@ async function _addScrapeJobToConcurrencyQueue(jobId: jobId,},priority: jobPriority,- }, webScraperOptions.scrapeOptions?.timeout ?? (60 * 1000));+ }, webScraperOptions.crawl_id ? Infinity :(webScraperOptions.scrapeOptions?.timeout ?? (60 * 1000)));}async function _addCrawlScrapeJobToConcurrencyQueue(