🪢 Open source agent evals & observability: Trace, evaluate, and improve LLM applications with one open platform.
TypeScript analyticsautogenevaluationlangchainlarge-language-modelsllama-indexllmllm-evaluationllm-observabilityllmopsmonitoringobservabilityopen-sourceopenaiplaygroundprompt-engineeringprompt-managementself-hostedycombinator
Commits on main
fix(ci): stop turbo serving e2e-server-tests a cached `start` (#18289)
415ba0c Der Gerät committed 1 month ago
ci: wait for the server to be ready before running web tests (#18288)
6efb65e Der Gerät committed 1 month ago
ci: retry failed test steps once in the merge queue (#18287)
d22b430 Der Gerät committed 1 month ago
refactor(query-ast): take a bare projectId in compileClickhouseQuery (#18817)
46debfe Niklas Semmler committed 1 month ago
chore: add code owners for shared normalization and transcripts (#18797)
6f2e38b marliessophie committed 1 month ago
fix(evals): attribute terminal LLM-as-judge failures by reason (#18821)
0793320 Tobias Wochinger committed 1 month ago
feat(topics): assign automatic summaries to the serving map and start first discovery (#18811)
4f172d3 Lysander Kiesel committed 1 month ago
chore: bump fast limit for early media check path (#18831)
bc1ade0 Valery Meleshkin committed 1 month ago
refactor(query-ast): inject the soft-delete filter on events reads (#18799)
8d7a8f7 Niklas Semmler committed 1 month ago
feat(topics): show facet descriptions in Configure Topics (#18753)
c900b11 Lysander Kiesel committed 1 month ago
feat(evals): restyle the evaluator gallery with score previews (#18709)
a1a9c0c Trang Nguyen committed 1 month ago
fix(query-ast): reject table-function sources in the tenancy pass (#18813)
f7c29b6 Niklas Semmler committed 1 month ago
fix(web): calmer chart palette with separate line and fill colours (#18692)
cd4571d Trang Nguyen committed 1 month ago
refactor(query-ast): type-check the events observation-by-id select (#18809)
47b198b Niklas Semmler committed 1 month ago
fix(web): filter chips and table cells use a design-system Tag (#18693)
67950a9 Trang Nguyen committed 1 month ago
fix(web): label non-chat input and output as Input and Output (#18787)
04e7458 Trang Nguyen committed 1 month ago
fix(web): quieter cost and usage breakdown tooltip (#18788)
3983d93 Trang Nguyen committed 1 month ago
fix(web): score chips stay visible on the selected trace tree row (#18680)
b09d366 Trang Nguyen committed 1 month ago
fix(gateway): enforce gateway invoke when API key roles are enforced (#18814)
fb4449a Tobias Wochinger committed 1 month ago
fix(web): dashboard chart tabs use design-system Tabs (#18538)
8d8bbb8 Trang Nguyen committed 1 month ago
fix(web): timeline gutter rows get the tree's left inset (#18695)
254d21b Trang Nguyen committed 1 month ago
fix(evals): send test evaluator runs through the live judge call (#18816)
4e5adc8 Tobias Wochinger committed 1 month ago
fix(api): add authentication span metadata to enforceAuth (#18807)
3bd4817 Mark Salpeter committed 1 month ago
fix(query-ast): take the last value of a duplicated metadata key in metadataValue (#18808)
2c13b3f Niklas Semmler committed 1 month ago
chore(review.md): improve frontend component rules (#18779)
593367d Ben Bachem committed 1 month ago
fix: keep webhook secrets out of logs and wait longer to connect (#18801)
cdc82e7 Tobias Wochinger committed 1 month ago
refactor(query-ast): build events I/O truncation and agent-graph metadata lookups with typed helpers (#18795)
1c9c672 Niklas Semmler committed 1 month ago
refactor(query-ast): bind JS Dates directly for DateTime64 params (#18800)
32903c1 Niklas Semmler committed 1 month ago