Supercharge your AI agents with data from the web and beyond. Building the library for superintelligence. 🔥
TypeScript aiai-agentsai-crawlerai-scrapingai-searchcrawlerdata-extractionhtml-to-markdownllmmarkdownscraperscrapingweb-crawlerweb-dataweb-data-extractionweb-scraperweb-scrapingweb-searchwebscraping
Commits on main
feat(scrape): add warning to document if it was concurrency limited (#1348)
200de9e Gergő Móricz committed 1 year ago
fix(v1/checkCredits): snap crawl limit to remaining credits if over without erroring out (#1350)
670ca84 Gergő Móricz committed 1 year ago
feat(v1/scrape): add further logging to document scrape bugs better
611c2d9 Gergő Móricz committed 1 year ago
fix(js-sdk/crawl,batch-scrape): retry status call if it returns an error up to 3 times (#1343)
ca93ba6 Gergő Móricz committed 1 year ago
Merge pull request #1336 from aparupganguly/feature/claude3.7-stock
905885a Eric Ciarla committed 1 year ago
fix(llmExtract): remove unsupported JSON schema properties (#1335)
c3ebfaf Gergő Móricz committed 1 year ago
fix(tests/snips/billing): don't wait 40s for nothing when self hosted
387dd3a Gergő Móricz committed 1 year ago
fix(crawler): sitemaps poisoning crawls with unrelated links (#1334)
c7ae50d Gergő Móricz committed 1 year ago