Skip to content

The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]

Commits on main

feat(wandb): add Beam 1.0 and GLM-5.3 to the cost map (#47690)
berriai-litellm-provider-info-sync[bot] committed 1 month ago
5e1e66d
d7c3588
feat(cost-map): add fireworks deepseek v4.1 flash 1017 us at the us-only premium (#47667)
berriai-litellm-provider-info-sync[bot] committed 1 month ago
5c836d6
fix(vertex-ai): drop flex prices from gemini-nano-banana-2.1 (#47666)
berriai-litellm-provider-info-sync[bot] committed 1 month ago
8e3ce6d