🪢 Open source agent evals & observability: Trace, evaluate, and improve LLM applications with one open platform.
TypeScript analyticsautogenevaluationlangchainlarge-language-modelsllama-indexllmllm-evaluationllm-observabilityllmopsmonitoringobservabilityopen-sourceopenaiplaygroundprompt-engineeringprompt-managementself-hostedycombinator
Commits on main
fix(trace-ui): on empty IO, show undefined for input and output (#18806)
291a332 Nimar committed 1 month ago
fix(sessions): read events_full when a metadata filter is truncation-sensitive (#18766)
ac2f830 Niklas Semmler committed 1 month ago
refactor(query-ast): share the events metadata map and trace session id from the AST (#18798)
2728f90 Niklas Semmler committed 1 month ago
fix(web): padded markdown box in the JSON view, aligned system prompt link (#18637)
8c26de8 Trang Nguyen committed 1 month ago
fix(query-ast): align registry column types with the ClickHouse DDL (#18793)
d17f6b7 Niklas Semmler committed 1 month ago
feat(billing): record billable units in an append-only ClickHouse ledger (#18722)
e6e7e35 Steffen Reuther committed 1 month ago
fix(evals): make model preflight schema explicit (#18772)
4718f90 Tobias Wochinger committed 1 month ago
refactor(topics): open Topics dialogs through DialogController (#18771)
655fb94 Lysander Kiesel committed 1 month ago
perf(sessions): let callers choose which session aggregates to compute (#18784)
abb396e Niklas Semmler committed 1 month ago
fix(otel): avoid native task dispatch for small media-free inputs (#18786)
4b3cedd Valery Meleshkin committed 1 month ago
refactor(query-ast): compile events I/O payload reads through the AST (#18417)
6cb7c51 Niklas Semmler committed 1 month ago
fix(deps): roll back Next.js and React to restore local development (#18738)
d3f0f7a Nikita Kabardin committed 1 month ago
fix(topics): resolve repeated topic names instead of failing the facet (#18781)
7b12f1b Lysander Kiesel committed 1 month ago
ci: apply ai-gateway-preview when gateway code changes (#18782)
2019597 Tobias Wochinger committed 1 month ago
fix(web): show a muted no-cost chip on generations with tokens but no cost (#18686)
d31d161 Trang Nguyen committed 1 month ago
fix(web): align prompt detail page with trace view styling (#18448)
65c78c7 Trang Nguyen committed 1 month ago
feat(llm): add organization-level connections (#18450)
40f84e7 Tobias Wochinger committed 1 month ago
feat: measure OTEL input preparation by media path (#18757)
bd891ba Valery Meleshkin committed 1 month ago
chore(worker): drop unused blob export metrics (#18770)
e1be1de Niklas Semmler committed 1 month ago
fix(worker): fail batch exports on ClickHouse timeout and memory errors without retry (#18724)
4ca2012 Niklas Semmler committed 1 month ago
refactor(query-ast): compile events simple aggregates through the AST (#18418)
d08d968 Niklas Semmler committed 1 month ago
fix(billing): raise default spend alert thresholds above plan base fees (#18768)
1cf6197 Steffen Reuther committed 1 month ago
fix(auth): clear stale email codes before sending a new one (#18767)
77bd7cb Steffen Reuther committed 1 month ago
fix(mcp): Limit observations tools for better performance (#18734)
78e3693 Ben Bachem committed 1 month ago