🪢 Open source agent evals & observability: Trace, evaluate, and improve LLM applications with one open platform.
TypeScript analyticsautogenevaluationlangchainlarge-language-modelsllama-indexllmllm-evaluationllm-observabilityllmopsmonitoringobservabilityopen-sourceopenaiplaygroundprompt-engineeringprompt-managementself-hostedycombinator
Commits on main
feat(ai-gateway): record model, key owner, byte and upstream error facts on generations (#19161)
a4348c9 Hassieb Pakzad committed 24 days ago
refactor(worker): move trace batch readiness scripts and selection into dedicated files (#19363)
651918f Lysander Kiesel committed 24 days ago
fix(ai-gateway): give telemetry flush its own shutdown budget (#19082)
12191aa Tobias Wochinger committed 25 days ago
fix(web): renew expired signed URLs when native media chips reopen (#19300)
b1e2305 Tobias Wochinger committed 25 days ago
chore(design-sync): apply fixes from the daily design-system sync (#19354)
b84a1ea Mark Salpeter committed 25 days ago
chore(design-sync): apply fixes from the daily design-system sync (#19297)
f0eb9e9 Mark Salpeter committed 25 days ago
chore(pricing): remove retired legacy OpenAI snapshots from the model picker (#19176)
602cbfd langfuse-bot committed 26 days ago
feat(web): jump to prompts, datasets, queues and evaluators from Cmd+K (#18921)
07e4504 Trang Nguyen committed 27 days ago
feat(evals): runBatchEvaluation MCP tool and batch_action_id on batch run outputs (#19314)
f3500cd Tobias Wochinger committed 27 days ago
fix(web): Topics shows analyzing, waiting and failed screens on the first run (#19285)
e139e39 Trang Nguyen committed 27 days ago
feat(ai-gateway): describe gateway keys inline and invite people from the keys page (#19310)
8aedbcc Tobias Wochinger committed 27 days ago
fix(web): Topics setup explains a missing AI connection and helps non-admins (#19286)
7d8bac6 Trang Nguyen committed 27 days ago
fix(clickhouse): label client-closed streams and tag the dashboard stream route (#19309)
4bbe46d Niklas Semmler committed 27 days ago
perf(scores): sort skip-dedup score lists by day first (#19311)
6060728 Niklas Semmler committed 27 days ago
feat(web): syntax-highlight shell, TOML and JSON setup snippets (#19306)
bb85692 Tobias Wochinger committed 27 days ago
refactor(ai-gateway): split setup instruction tabs from data loading and add stories (#19307)
32e19e0 Tobias Wochinger committed 27 days ago
refactor(web): Unify tooltip and hover card behavior (#19303)
f65227a Ben Bachem committed 27 days ago
refactor(web): Make SpendAlertsTable use design system (#19305)
5dc7959 Ben Bachem committed 27 days ago
feat(ai-gateway): update Claude Desktop setup steps and merge Claude tabs (#19298)
b1f9381 Tobias Wochinger committed 27 days ago
fix(security): require secrets again when webhook or PostHog destination changes (#19261)
6d69358 Niklas Semmler committed 27 days ago
feat(public-api): add unstable read-only Topics endpoints (#19104)
14986f6 Lysander Kiesel committed 27 days ago
test(sessions): pin project scoping for tool filters on the events sessions table (#19293)
48805f3 Niklas Semmler committed 27 days ago