🪢 Open source agent evals & observability: Trace, evaluate, and improve LLM applications with one open platform.
TypeScript analyticsautogenevaluationlangchainlarge-language-modelsllama-indexllmllm-evaluationllm-observabilityllmopsmonitoringobservabilityopen-sourceopenaiplaygroundprompt-engineeringprompt-managementself-hostedycombinator
Commits on main
fix(api): type OtelSpan scalars and dataset JSON-schema fields in OpenAPI (#17892)
62b7c3e Niklas Semmler committed 1 month ago
fix(batch-export): surface the real read failure, not a generic S3 error (#17891)
20a2613 Niklas Semmler committed 1 month ago
perf(scores): raise idx_project_trace_observation granularity to 2 (#17882)
7a63d27 Niklas Semmler committed 1 month ago
feat(ai-gateway): batch inference telemetry per project and retry transient failures (#17855)
943272e Hassieb Pakzad committed 1 month ago
refactor(api): unify cursor pagination meta into a shared envelope (#17888)
ce4a1e9 Niklas Semmler committed 1 month ago
chore(worker): cover OTEL replay with provider fixtures and properties (#17742)
2ba0809 Valery Meleshkin committed 1 month ago
fix(shared): keep metadata keys that collide with Object.prototype (#17686)
21fb09d Ramanjot Singh committed 1 month ago
refactor(web): Make score analytics charts re-use design-system charts (#17885)
96f58d0 Ben Bachem committed 1 month ago
chore(pricing): let the model price audit verify jev pricing against TypeSafe docs (#17859)
f21a5bc langfuse-bot committed 1 month ago
feat(llm-connections): default and custom models for TypeSafe connections (#17881)
dab0b84 Hassieb Pakzad committed 1 month ago
test(scores): give the updated score a strictly later event_ts (#17879)
32b1e70 Steffen Reuther committed 1 month ago
fix(charts): Make PieChart colors match other charts (#17875)
9b7ccf6 Ben Bachem committed 1 month ago
feat(llm-connections): custom base URL and extra headers for TypeSafe connections (#17866)
d7ae7f0 Hassieb Pakzad committed 1 month ago
refactor(web): Create design-system StackedBarChart (#17865)
e3c7b90 Ben Bachem committed 1 month ago
feat(billing): send the organization name on ClickHouse Billing checkout (#17867)
9450b93 Steffen Reuther committed 1 month ago
refactor(web): Migrate exports settings table to design system (#17864)
b9c8f6c Ben Bachem committed 1 month ago
fix(web): use tuple key for confusion matrix lookup to avoid delimiter collisions (#17196)
aa44661 marliessophie committed 1 month ago
refactor(web): Migrate sso settings table to design system (#17863)
0181935 Ben Bachem committed 1 month ago
feat(billing): show only Total in invoice history for ClickHouse Billing orgs (#17851)
8b92732 Steffen Reuther committed 1 month ago
perf(scores): add selective-seek path for scores dedup reads (#17842)
72294f5 Niklas Semmler committed 1 month ago
chore(redis): expire failed export jobs by age instead of count cap (#17827)
5e53b9b Niklas Semmler committed 1 month ago
feat(ai-gateway): capture Anthropic Messages content in full mode (#17854)
ce3ef13 Hassieb Pakzad committed 1 month ago
feat(ai-gateway): relay Anthropic Messages with usage telemetry (#17781)
7ad9dfe Hassieb Pakzad committed 1 month ago
fix(billing): clear a pending ClickHouse Billing scheduled change before setting a new one (#17811)
3d9973e Steffen Reuther committed 1 month ago