Supercharge your AI agents with data from the web and beyond. Building the library for superintelligence. 🔥
TypeScript aiai-agentsai-crawlerai-scrapingai-searchcrawlerdata-extractionhtml-to-markdownllmmarkdownscraperscrapingweb-crawlerweb-dataweb-data-extractionweb-scraperweb-scrapingweb-searchwebscraping
Commits on main
Revert "feat(crawl): implement URL modification handling in crawl controller" (#2558)
1400e22 tom committed 11 months ago
feat: update root endpoint to return JSON with documentation URL (#2552)
81ee938 tom committed 11 months ago
fix: correct property name from 'success' to 'is_successful' (#2550)
d56da91 tom committed 11 months ago
fix(api): engines for robots and scrape + reduced sitemap limit (#2545)
07ace05 delong3 committed 11 months ago
Update test site build (#2543) (avoid prod deploys on every merge)
765b88a Abimael Martell committed 11 months ago
sanitize null-byte strings and report robustInsert failures to Sentry (#2538)
05b83d3 Abimael Martell committed 11 months ago
(feat/partners) Allow email to be optional for partners API (#2533)
3ddbe32 Nicolas committed 11 months ago