Supercharge your AI agents with data from the web and beyond. Building the library for superintelligence. 🔥
TypeScript aiai-agentsai-crawlerai-scrapingai-searchcrawlerdata-extractionhtml-to-markdownllmmarkdownscraperscrapingweb-crawlerweb-dataweb-data-extractionweb-scraperweb-scrapingweb-searchwebscraping
Commits on main
Merge pull request #944 from BexTuychiev/scheduling_deploying_scrapers
35d9d8e Eric Ciarla committed 1 year ago
fix(scrapeURL/removeUnwantedElements): try to fix onlyMainContent for poorly structured sites
6b1f30e Gergő Móricz committed 1 year ago
Merge pull request #940 from mendableai/nsc/crawl-fixes-not-respecting-limit
a5eaa60 Nicolas committed 1 year ago