🪢 Open source agent evals & observability: Trace, evaluate, and improve LLM applications with one open platform.
TypeScript analyticsautogenevaluationlangchainlarge-language-modelsllama-indexllmllm-evaluationllm-observabilityllmopsmonitoringobservabilityopen-sourceopenaiplaygroundprompt-engineeringprompt-managementself-hostedycombinator
Commits on main
feat(topics): guided first run with combined backfill and progress (#19088)
cde1f52 Lysander Kiesel committed 29 days ago
perf(scores): allow skipping scores dedup for projects that never update scores (#19157)
2ec7d56 Niklas Semmler committed 29 days ago
feat(events): control table UI sections independently (#19190)
225bd98 tobi_kl committed 29 days ago
fix(web): block scores, labels, evaluator picker and dataset scalars from session replay (#19184)
f4f3a40 Tobias Wochinger committed 29 days ago
test(external-media-storage): cover tRPC SSRF and access-control negatives (#19185)
0ab4482 Tobias Wochinger committed 29 days ago
fix(entitlements): restrict audit logs to enterprise plans (#19170)
f24a241 Steffen Reuther committed 29 days ago
refactor(query-ast): read events only through logical relations (#19172)
c978cf4 Niklas Semmler committed 29 days ago
fix(mcp): upgrade SDK to 1.32.0 and bound request validation (#19141)
2c80d43 Nimar committed 29 days ago
refactor(web): Resolve some component-file-structure issues (#19165)
66fcfd3 Ben Bachem committed 29 days ago
fix(sessions): Add experimental root only mode for session transcripts (#19145)
08457e2 Ben Bachem committed 29 days ago
fix(mcp): back off observation searches after resource errors (#19175)
b914c2a Valery Meleshkin committed 29 days ago
refactor(query-ast): compile session trace identifiers through the AST (#19085)
d43abd9 Niklas Semmler committed 29 days ago
fix(query-ast): reject identifiers that are not plain names (#19034)
6810062 Niklas Semmler committed 29 days ago
fix(evals): pass experiment context to v2 code evaluator test runs (#19167)
6193721 Tobias Wochinger committed 29 days ago
feat(ai-gateway): let members create their own gateway API keys (#19160)
fdff585 Tobias Wochinger committed 29 days ago
fix(ai-gateway): show credential details while models load (#19163)
4c013e7 Tobias Wochinger committed 29 days ago
fix(web): make the env label badge dismissible again (#18977)
cf60f7b Der Gerät committed 29 days ago
chore(eslint): flag unescaped values in SQL LIKE patterns (#19147)
7431f91 Niklas Semmler committed 29 days ago
refactor(query-ast): render events aggregation builders from typed selects (#19086)
2e40ea9 Niklas Semmler committed 29 days ago
feat(api): limit legacy ingestion to scores for new organizations (#19042)
348afb0 Max Deichmann committed 29 days ago
fix(sso): use one discovery URL for OneLogin validation and sign-in (#18951)
8d6ed36 Nobuchika Kamon committed 29 days ago
feat(ai-gateway): global enable flag and derived JWT public key / key ID for self-hosting (#19159)
4a85414 Tobias Wochinger committed 29 days ago
feat(blob-export): add opt-in score metadata and provenance field groups (#19138)
46d50a3 Niklas Semmler committed 29 days ago
fix(web): keep Topics treemap tile names from running under the count (#19151)
8e5557d Lysander Kiesel committed 29 days ago
fix(ui): centre badge label in both badge primitives (#18982)
9af461c Der Gerät committed 29 days ago