🪢 Open source agent evals & observability: Trace, evaluate, and improve LLM applications with one open platform.
TypeScript analyticsautogenevaluationlangchainlarge-language-modelsllama-indexllmllm-evaluationllm-observabilityllmopsmonitoringobservabilityopen-sourceopenaiplaygroundprompt-engineeringprompt-managementself-hostedycombinator
Commits on main
feat: add API spec previews for pull requests (#16833)
4b01cf6 Tobias Wochinger committed 2 months ago
fix(in-app-agent): derive the MCP endpoint from its own base URL (#16837)
b794a5c Lysander Kiesel committed 2 months ago
refactor(web): Extract `createDropdownTableColumn` (#16830)
a88f14d Ben Bachem committed 2 months ago
refactor(web): Clean up `NewDatasetItemFromExistingObject` (#16782)
3bb7c17 Ben Bachem committed 2 months ago
chore(eslint): Enforce design-system import boundary (#16828)
9931270 Ben Bachem committed 2 months ago
refactor(web): Extract `createTokenUsageTableColumn` (#16829)
ed2aa5d Ben Bachem committed 2 months ago
feat(web): instrument filter sidebar expand usage (#16769)
65d6230 Trang Nguyen committed 2 months ago
fix(api): keep historical evaluation rule filters readable (#16819)
4e0ce09 Tobias Wochinger committed 2 months ago
refactor(web): Inline table loading cell components (#16785)
e61fdaa Ben Bachem committed 2 months ago
feat(evals): add next-step state line to evaluator setup footer (#16817)
da05c4f Tobias Wochinger committed 2 months ago
feat(evals): filter evaluator samples by dataset name (#16799)
b5a9ed2 Tobias Wochinger committed 2 months ago
feat(mcp): describe evaluator output definitions (#16816)
57a5b6c Tobias Wochinger committed 2 months ago
fix(evals): show custom model configuration (#16815)
9821a5b Tobias Wochinger committed 2 months ago
fix(datasets): read v4 experiment metrics from events (#16814)
05ecd21 Tobias Wochinger committed 2 months ago
refactor(evals): rename evaluation RBAC scopes (#16648)
1124345 Tobias Wochinger committed 2 months ago
fix(billing): read the CHB checkout URL from checkoutUrl (#16800)
f6e56cb Steffen Schmitz committed 2 months ago
fix(otel): denormalize AI-feature child trace names for cost filters (#16793)
e94743f Lysander Kiesel committed 2 months ago
docs(agents): add a brake before new concepts in shared backend code (#16792)
08c496a Valery Meleshkin committed 2 months ago
fix(web): drop interactive transaction from API-key audit logs (#16748)
388f2aa Niklas Semmler committed 2 months ago
feat(web): reframe migration headline around the compatibility deadline (#16776)
ab616da Max Deichmann committed 2 months ago
feat(query-ast): clean Kysely base for the ClickHouse query AST (#16687)
8521ece Niklas Semmler committed 2 months ago
fix(ui): collapse long system prompts from the message header (#16582)
1aa538f Nikita Kabardin committed 2 months ago
feat(csv): enhance CSV parsing with error handling for large and malformed files in preview mode (#16476)
e5164be marliessophie committed 2 months ago
fix: harden OTel attribute path reconstruction (#16681)
02f1d8e Valery Meleshkin committed 2 months ago