🪢 Open source agent evals & observability: Trace, evaluate, and improve LLM applications with one open platform.
TypeScript analyticsautogenevaluationlangchainlarge-language-modelsllama-indexllmllm-evaluationllm-observabilityllmopsmonitoringobservabilityopen-sourceopenaiplaygroundprompt-engineeringprompt-managementself-hostedycombinator
Commits on main
feat(in-app-agent): record tool approval source in the event stream (#16372)
c340225 Lysander Kiesel committed 2 months ago
refactor(web): Create more feature dirs in storybook (#16521)
0a2c92b Ben Bachem committed 2 months ago
feat(evals): refresh all-caps, exact-match, and keyword-overlap templates (#16515)
212be78 annabellscha committed 2 months ago
fix(assistant): Optimize sandbox & silent mcp tool prompt guidance (#16411)
fa01af7 Ben Bachem committed 2 months ago
fix(evals): render boolean test results as text (#16514)
8dc616d Tobias Wochinger committed 2 months ago
refactor(web): clean up `CreateProjectMemberButton` (#16483)
971a7a5 Ben Bachem committed 2 months ago
fix(evals): preserve LLM judge BullMQ retries (#16510)
b4fe77f Tobias Wochinger committed 2 months ago
fix: enforce OTLP ingestion request body limits (#16487)
ea3c905 Valery Meleshkin committed 2 months ago
feat(evals): add payload-backed evaluation rule filters (#16484)
c293124 Tobias Wochinger committed 2 months ago
fix(automations): require fresh tokens for dispatch URL changes (#16479)
bbc391c Hassieb Pakzad committed 2 months ago
fix: reject filters on pair-expanded dimensions (#16481)
f6725ae Valery Meleshkin committed 2 months ago
fix(shared): apply score pagination when offset is 0 (#16405)
9d9abfa Niklas Semmler committed 2 months ago
fix(experiments): keep evaluator search modal mounted (#16482)
7a2665f Tobias Wochinger committed 2 months ago
chore(pricing): cut gpt-5.6-sol price across all tiers (#16436)
24062d4 langfuse-bot committed 2 months ago
feat(in-app-agent): Add Anthropic Messages as a supported model provider for Langfuse Assistant (OSS) (#16385)
014a2d9 Lysander Kiesel committed 2 months ago
feat(evals): show and filter evaluator models (#16466)
7d62bce Tobias Wochinger committed 2 months ago
fix(evals): activate disabled rules on evaluator attach (#16465)
81b1e75 Tobias Wochinger committed 2 months ago
test: stabilize evaluator and SSRF integration coverage (#16468)
3758297 Tobias Wochinger committed 2 months ago
fix(evals): stop validating rule mappings when updating an evaluator (#16460)
cb823da cursor[bot] committed 2 months ago
feat(onboarding): Ask to enable AI features during onboarding (#16389)
e9b6cbf Ben Bachem committed 2 months ago
fix: sidestep 500 on NextAuth HTML routes when callback URL is invalid (#16461)
8f5fff8 Valery Meleshkin committed 2 months ago
feat(in-app-agent): cache stable Bedrock prefixes across turns (#16459)
ce7c979 Lysander Kiesel committed 2 months ago
docs(seeder): show `supportsV4` marker in `list` subcommand text output (#16430)
9e737c0 Harsh Kashyap committed 2 months ago
feat(annotation-queues): create queues from events table (#16427)
dba6281 Ben Bachem committed 2 months ago