Supercharge your AI agents with data from the web and beyond. Building the library for superintelligence. 🔥
TypeScript aiai-agentsai-crawlerai-scrapingai-searchcrawlerdata-extractionhtml-to-markdownllmmarkdownscraperscrapingweb-crawlerweb-dataweb-data-extractionweb-scraperweb-scrapingweb-searchwebscraping
Commits on main
Merge pull request #1063 from mendableai/nsc/__experimental_streamSteps
0496b79 Nicolas committed 1 year ago
fix(scrapeURL/loop): re-add is long enough check with lt 0
97bf542 Gergő Móricz committed 1 year ago
fix(queue-worker/crawl): use SCARD to generate num_docs field
49e584f Móricz Gergő committed 1 year ago