🪢 Open source agent evals & observability: Trace, evaluate, and improve LLM applications with one open platform.
TypeScript analyticsautogenevaluationlangchainlarge-language-modelsllama-indexllmllm-evaluationllm-observabilityllmopsmonitoringobservabilityopen-sourceopenaiplaygroundprompt-engineeringprompt-managementself-hostedycombinator
Commits on main
feat(in-app-agent): prompt cache breakpoints for Claude behind an OpenAI Responses gateway (#16865)
72e8be9 David Traina committed 2 months ago
fix(web): drop Android WebView Java-bridge listener noise from Sentry (#16857)
8508885 cursor[bot] committed 2 months ago
fix(in-app-agent): force reasoning for Claude ids on the OpenAI Responses path (#16864)
de34d7e David Traina committed 2 months ago
fix(shared): emit equal-sized S3 multipart parts from buffered uploader (#16754)
80998f4 Niklas Semmler committed 2 months ago
fix(dashboards): avoid duplicate ARRAY JOIN aliases for usage and cost type (#16750)
88bade5 Niklas Semmler committed 2 months ago
feat(api): add self-hosted API specification renderer (#16845)
d0926f9 Tobias Wochinger committed 2 months ago
ci: fail PRs when served OpenAPI specs drift from Fern (#16749)
6d96b32 Niklas Semmler committed 2 months ago
fix(evals): expand selected gallery categories (#16867)
558daac Tobias Wochinger committed 2 months ago
fix(api): treat prompt version metrics dimensions as numbers (#16746)
d91c904 Niklas Semmler committed 2 months ago
fix(worker): harden analytics export URL checks and host logging (#16743)
10a3922 Niklas Semmler committed 2 months ago
chore(workflows): enable Dependabot security upgrade PRs (#16856)
983c2a6 Nimar committed 2 months ago
fix(in-app-agent): surface output-token truncation instead of a blank turn (#16803)
8cad3e2 David Traina committed 2 months ago
feat(noramlized-io): hook up parser trace io behind feature flag (#16775)
fbd612a marliessophie committed 2 months ago
fix(otel): parse prompt version attributes as integers (#16805)
6d8ffef David Traina committed 2 months ago
fix(in-app-agent): keep OpenAI Responses calls stateless (#16810)
64a9905 David Traina committed 2 months ago
chore(ingestion): add sdk/attributeKey/parse-failure-kind tags to metadata_dropped (#16850)
fe6645e Niklas Semmler committed 2 months ago
chore(query-ast): add tier 5-7 catalog shapes (#16846)
5014380 Niklas Semmler committed 2 months ago
fix(in-app-agent): keep the redirect tool schema within OpenAI's accepted nesting (#16809)
5ef2c03 David Traina committed 2 months ago
refactor(web): Continue ID table column standardization (#16848)
3b0a8a0 Ben Bachem committed 2 months ago
fix(evals): avoid reasoning collisions in structured output (#16843)
162887c Tobias Wochinger committed 2 months ago
chore(ingestion): tag metadata_dropped with projectId, drop OTel warn log (#16844)
a1b188c Niklas Semmler committed 2 months ago
feat(traces): link evaluator execution traces (#16839)
02c77e6 Tobias Wochinger committed 2 months ago