🪢 Open source agent evals & observability: Trace, evaluate, and improve LLM applications with one open platform.
TypeScript analyticsautogenevaluationlangchainlarge-language-modelsllama-indexllmllm-evaluationllm-observabilityllmopsmonitoringobservabilityopen-sourceopenaiplaygroundprompt-engineeringprompt-managementself-hostedycombinator
Commits on main
feat(shared): add toolCallInvocations measure for per-tool invocation counts (#16622)
3466904 Trang Nguyen committed 2 months ago
feat(evals): allow restoring evaluator versions (#16674)
17cd982 Tobias Wochinger committed 2 months ago
fix(api): bound legacy dataset item responses (#16676)
ba2dfc5 Tobias Wochinger committed 2 months ago
fix(blob-export): half-open export time window to stop chunk-boundary double-count (#16613)
a53d296 Niklas Semmler committed 2 months ago
fix(api): propagate deprecations to generated SDKs (#16673)
99e2ce9 Hassieb Pakzad committed 2 months ago
feat(worker): export dashboards and widgets in the core data S3 export (#16621)
d61909d Trang Nguyen committed 2 months ago
fix(self-hosting): respect DATABASE_PORT when composing DATABASE_URL in entrypoints (#16605)
1172c4e qwerty2944 committed 2 months ago
feat(telemetry): report AI feature and Assistant enablement from self-hosted (#16587)
40bf53b Lysander Kiesel committed 2 months ago
feat(in-app-agent): support OpenAI-compatible APIs for instance AI features (#16581)
67eec1c Lysander Kiesel committed 2 months ago
feat(in-app-agent): default Assistant worker surfaces to LANGFUSE_IN_APP_AGENT_ENABLED (#16646)
0f062be Lysander Kiesel committed 2 months ago
feat(web): instrument dashboard and widget usage in PostHog (#16626)
a8a0a3b Trang Nguyen committed 2 months ago
fix: prevent prototype-chain clobbering in OTel attribute mapping (#16616)
1c5df63 Valery Meleshkin committed 2 months ago
fix(in-app-agent): teach traces vs observations in the system prompt (#16617)
e964e28 Lysander Kiesel committed 2 months ago
feat(web): allow serving build output from a dedicated asset host (#16546)
dd18496 Steffen Schmitz committed 2 months ago
feat(evals): track evaluator creation configuration (#16624)
b27b66a Tobias Wochinger committed 2 months ago
fix(in-app-agent): map MCP tool results to AI SDK model output (#16618)
9f84a45 Lysander Kiesel committed 2 months ago
fix(web): treat elkjs stack overflow as too-large graph (#16572)
1d14a4e cursor[bot] committed 2 months ago
fix(web): remove dev-only widget-bar-spacing test page (#16619)
72a8ca4 Trang Nguyen committed 2 months ago