🪢 Open source agent evals & observability: Trace, evaluate, and improve LLM applications with one open platform.
TypeScript analyticsautogenevaluationlangchainlarge-language-modelsllama-indexllmllm-evaluationllm-observabilityllmopsmonitoringobservabilityopen-sourceopenaiplaygroundprompt-engineeringprompt-managementself-hostedycombinator
Commits on main
refactor: Resolve @repo/no-exotic-operators issues (#18169)
0ee8fbd Ben Bachem committed 1 month ago
feat(audit-logs): log actor info for audited actions and deletions (#18107)
b036980 Pratima Patel committed 1 month ago
feat(experiments): annotate directly from comparison grid (#17990)
a9a99bd marliessophie committed 1 month ago
fix(dashboards): return 404 when deleting a missing widget (#17673)
74512fc Max Deichmann committed 1 month ago
fix(api-auth): return 404 when mutating a missing API key (#17677)
da578c2 Max Deichmann committed 1 month ago
fix(web): return NOT_FOUND for missing model and LLM-connection deletes (#17672)
88384a5 Max Deichmann committed 1 month ago
fix(tracing): preserve missing trace error on publish (#17668)
2e07e44 Max Deichmann committed 1 month ago
fix(annotation-queues): return not found when deleting a missing queue (#17671)
66f4880 Max Deichmann committed 1 month ago
fix(billing): treat missing subscription reactivation as a client error (#17675)
652651a Max Deichmann committed 1 month ago
fix(web): return not found when cancelling a missing batch export (#17676)
306a8a2 Max Deichmann committed 1 month ago
fix(web): return not-found for missing score config byId (#17679)
0f70e58 Max Deichmann committed 1 month ago
fix(datasets): return 404 when updating a missing dataset (#17670)
c37160d Max Deichmann committed 1 month ago
chore(dx): enable pnpm dedupe and task-aware turbo watch (#17852)
f75c661 Nimar committed 1 month ago
fix(tracing): collapse detail tabs on measured width, not a fixed breakpoint (#18175)
712dd47 Der Gerät committed 1 month ago
fix(web): Make sure label doesn't overlap arc in PieChart (#18174)
829cf03 Ben Bachem committed 1 month ago
feat(mcp): support decision-model evaluators (#18166)
e59efe0 Tobias Wochinger committed 1 month ago
fix(sessions): Give marker icons a visible tooltip (#18156)
3faca12 Der Gerät committed 1 month ago
chore(deps): bump the rust-dependencies group in /ai-gateway with 6 updates (#18146)
3449fb5 dependabot[bot] committed 1 month ago
fix(otel): preserve batches with valueless attributes (#18104)
f5967f3 Valery Meleshkin committed 1 month ago
feat(evals): add facet type, built-in protection, and rule idle time (#18144)
cd8f350 Lysander Kiesel committed 1 month ago
fix(evals): validate evaluator models before saving (#18145)
c0e82da Tobias Wochinger committed 1 month ago
fix(web): label the S3 blob storage export provider as Amazon S3 (#18152)
564e8d6 jordibosch20 committed 1 month ago
fix(evals): reflect evaluator model availability (#18143)
d418eae Tobias Wochinger committed 1 month ago