🪢 Open source agent evals & observability: Trace, evaluate, and improve LLM applications with one open platform.
TypeScript analyticsautogenevaluationlangchainlarge-language-modelsllama-indexllmllm-evaluationllm-observabilityllmopsmonitoringobservabilityopen-sourceopenaiplaygroundprompt-engineeringprompt-managementself-hostedycombinator
AI Gateway
Implementation
- performance of the
/resolveAPI path is critical - ideally stays under 10ms - no tautological frontend component tests that check stuff like height / width
Testing
- When changing the core flow or model provider-specifics: ensure that the end-to-end test suite
remains valid:
web/src/__e2e__/ai-gateway.gatewaye2e.ts. Vitest starts the built binary and sends model listing, client errors, and slugless completions through it.