Supercharge your AI agents with data from the web and beyond. Building the library for superintelligence. 🔥
TypeScript aiai-agentsai-crawlerai-scrapingai-searchcrawlerdata-extractionhtml-to-markdownllmmarkdownscraperscrapingweb-crawlerweb-dataweb-data-extractionweb-scraperweb-scrapingweb-searchwebscraping
fix(batch-scrape): auto finish "kickoff" (no kickoff)
Móricz Gergő2cf7a4f57a4f
diff --git a/apps/api/src/controllers/v1/batch-scrape.ts b/apps/api/src/controllers/v1/batch-scrape.tsindex 21c9745cc..d2c079bf4 100644--- a/apps/api/src/controllers/v1/batch-scrape.ts+++ b/apps/api/src/controllers/v1/batch-scrape.ts@@ -11,6 +11,7 @@ import {} from "./types";import {addCrawlJobs,+ finishCrawlKickoff,getCrawl,lockURLs,saveCrawl,@@ -131,6 +132,8 @@ export async function batchScrapeController(};});+ await finishCrawlKickoff(id);+logger.debug("Locking URLs...");await lockURLs(id,