Supercharge your AI agents with data from the web and beyond. Building the library for superintelligence. 🔥
TypeScript aiai-agentsai-crawlerai-scrapingai-searchcrawlerdata-extractionhtml-to-markdownllmmarkdownscraperscrapingweb-crawlerweb-dataweb-data-extractionweb-scraperweb-scrapingweb-searchwebscraping
Commits on main
fix(crawler): relative URL handling on non-start pages (#893)
fbabc77 Gergő Móricz committed 2 years ago
feat(crawl): add parameter to treat differing query parameters as different URLs (#892)
a8dc75f Gergő Móricz committed 2 years ago