Skip to content

The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]

Commits on main

f2118fc
b6f91a2
chore(cost-map): add fireworks muse spark open priority prices from the pricing page (#47785)
berriai-litellm-provider-info-sync[bot] committed 29 days ago
159b5b2
fix(pricing): update baseten reflection/Beam-1.0 prices from the models API (#47784)
berriai-litellm-provider-info-sync[bot] committed 29 days ago
1fcbb03
045fb7b
feat(azure): add azure_ai/MAI-Code-1.1-Flash (#47779)
berriai-litellm-provider-info-sync[bot] committed 29 days ago
4ecc5fd
cc156a7