Supercharge your AI agents with data from the web and beyond. Building the library for superintelligence. 🔥
TypeScript aiai-agentsai-crawlerai-scrapingai-searchcrawlerdata-extractionhtml-to-markdownllmmarkdownscraperscrapingweb-crawlerweb-dataweb-data-extractionweb-scraperweb-scrapingweb-searchwebscraping
Commits on main
Handle missing monitor.targets and route search queue
c81c83e Developers Digest committed 4 months ago
monitor: isolate search checks on a dedicated queue + consumer
8985153 Developers Digest committed 4 months ago
monitor search: parallelize deep-mode per-result scrapes
2602601 Developers Digest committed 4 months ago
monitor search: warn when a check retrieves zero results
596c725 Developers Digest committed 4 months ago
monitor search: clearer error when searchWindow is invalid
40bc0b7 Developers Digest committed 4 months ago
monitor search: simplify over-long queries on empty result, not just boolean
8962089 Developers Digest committed 4 months ago
monitor search: make verifier subject_missing advisory, not blocking
c3ca73d Developers Digest committed 4 months ago
monitor search: more persistent retry on transient empty results
86562ab Developers Digest committed 4 months ago
monitor search: retry with a simplified query when a boolean query returns 0 results
1ab4ad5 Developers Digest committed 4 months ago
monitor search: dedupe by canonical URL, not snippet text
8b80cac Developers Digest committed 4 months ago
Merge pull request #3766 from firecrawl/jonathan/search-monitoring
60298e8 Developers Digest committed 4 months ago
Lower judge credit cost and skip judgments in raw mode
2079301 Developers Digest committed 4 months ago
Use configurable public host for self-hosted response URLs (#3699)
2dd97c6 Saivedant Hava committed 5 months ago
monitor search: route deep-mode scrape through the shared scrape path
43a50c5 Developers Digest committed 5 months ago
monitor search: attach Vertex billing labels to every LLM call
e485f7d Developers Digest committed 5 months ago
monitor search: prefer Vertex, fall back to GenAI for LLM calls
0510fb1 Developers Digest committed 5 months ago
Add MonitorTargetResult type and use in MonitorCheck
865cf2b Developers Digest committed 5 months ago