Supercharge your AI agents with data from the web and beyond. Building the library for superintelligence. 🔥
TypeScript aiai-agentsai-crawlerai-scrapingai-searchcrawlerdata-extractionhtml-to-markdownllmmarkdownscraperscrapingweb-crawlerweb-dataweb-data-extractionweb-scraperweb-scrapingweb-searchwebscraping
Commits on main
feat(v1/search): add query to logs to make debugging 502s easier
0365e3d Gergő Móricz committed 1 year ago
ENG-3089: Support both string and object format inputs in v2 scrape API (#1932)
64e3e79 Gergő Móricz committed 1 year ago
fix(tests/scrape): make `maxAge: 0` explicit in Index tests (#1946)
e9b2194 Gergő Móricz committed 1 year ago
test(v2/crawl): implement tests for crawl API with prompt parameter (#1929)
8be0eb8 Gergő Móricz committed 1 year ago
feat(api/ai-sdk): add labels to vertex/google calls (#1944)
91d19fe Gergő Móricz committed 1 year ago
feat(scrape-worker): reintroduce OTEL for accurate LLM cost tracking (#1943)
ae6a052 Gergő Móricz committed 1 year ago
feat(scrapeURL/pdf): add further logging to analyze remaining time in timeout messages
506c4b2 Gergő Móricz committed 1 year ago
fix(scrapeURL/pdf): better timeout error for PDF scrapes (#1942)
f5b73b6 Gergő Móricz committed 1 year ago
fix(queue-worker): turn off useWorkerThreads in sandboxed scrape worker (#1941)
bd5adfe Gergő Móricz committed 1 year ago
Merge pull request #1852 from mendableai/draft/search-with-x402
8b89470 Ademílson Tonato committed 1 year ago
(python-sdk): removed client duplication, bunch of type fixing, added map method + e2e/unit tests
dd6b46d rafaelmmiller committed 1 year ago
fix(queue-worker): remove OTEL undici/http instrumentations
392cb5f Gergő Móricz committed 1 year ago