The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]
Python ai-gatewayanthropicazure-openaibedrockgatewaylangchainlitellmllmllm-gatewayllmopsmcp-gatewayopenaiopenai-proxyrustrust-aivertex-ai
| Name | Last commit message | Last commit date |
|---|---|---|
| .. | ||
| __init__.py 0 B | ||
| anthropic.py 10.9 KB | ||
| azure.py 14.2 KB | ||
| bedrock_converse.py 10.2 KB | ||
| bedrock_invoke.py 6.2 KB | ||
| bedrock_mantle.py 13.7 KB | ||
| gemini.py 11.9 KB | ||
| openai.py 28.6 KB | ||
| vertex_ai.py 19.8 KB | ||