🪢 Open source agent evals & observability: Trace, evaluate, and improve LLM applications with one open platform.
TypeScript analyticsautogenevaluationlangchainlarge-language-modelsllama-indexllmllm-evaluationllm-observabilityllmopsmonitoringobservabilityopen-sourceopenaiplaygroundprompt-engineeringprompt-managementself-hostedycombinator
Commits on main
refactor(web): drop nested ternary in notification channel list (#19488)
8f809ee cursor[bot] committed 20 days ago
refactor(web): drop unused support form section schema (#19485)
e815176 cursor[bot] committed 20 days ago
fix(shared): retry Prisma reads on transient Postgres connection errors (#19480)
8ddebc0 Niklas Semmler committed 20 days ago
chore(ai-gateway): drop the staging special case for the gateway URL (#19482)
ce767a9 Tobias Wochinger committed 20 days ago
build(deps): bump the rust-dependencies group in /ai-gateway with 3 updates (#19476)
97c6baa dependabot[bot] committed 21 days ago
ci(deploy): deploy ai-gateway with every prod push and remove the temporary ECS service check (#19475)
5cb2047 Hassieb Pakzad committed 21 days ago
ci(deploy): allow ai-gateway deploys to prod and skip rollout when the ECS service is missing (#19470)
a7cfd8c Hassieb Pakzad committed 21 days ago
fix(clickhouse): materialize legacy scores columns in migration 0050 (#19443)
ff8a520 Steffen Reuther committed 21 days ago
feat(ai-gateway): filter gateway analytics by user and API key (#19458)
71ddcb9 Tobias Wochinger committed 21 days ago
feat(ai-gateway): default service key user ID to the key name (#19459)
5dbf978 Tobias Wochinger committed 21 days ago
build(ai-gateway): shrink the runtime image by pinning coreutils-single and dropping openssl-libs (#19463)
b94995a Tobias Wochinger committed 21 days ago
chore(design-sync): apply fixes from the daily design-system sync (#19461)
6c2ed22 Mark Salpeter committed 21 days ago
feat(ai-gateway): add an analytics tab to the AI Gateway settings (#19417)
07548eb Tobias Wochinger committed 22 days ago
feat(evals): add filter conditions for trace-level (#19400)
7a15e69 marliessophie committed 22 days ago
perf(worker): use full job_executions index when deleting traces (#19451)
b1067f3 Niklas Semmler committed 22 days ago
feat(pagerduty): send alerts, project notifications and prompt changes to PagerDuty, with the routing key on the automation (#19411)
7adf573 Mark Salpeter committed 22 days ago
chore(ai-gateway): drop user-id header from gateway setup instructions (#19445)
6527062 Tobias Wochinger committed 22 days ago
feat(telemetry): report AI gateway request counts from self-hosted instances (#19433)
7e5c843 Tobias Wochinger committed 22 days ago
chore(evals): remove obsolete managed evaluator catalog (#19321)
b51b396 AkioNuernberger committed 22 days ago
chore(eslint): allow functions and classes below their callers in no-use-before-define (#19424)
2baf215 Mark Salpeter committed 22 days ago
fix(ai-gateway): allow deleting the ingestion project once ingestion is None (#19434)
ebed92e Tobias Wochinger committed 22 days ago