Skip to content

The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]

8 labels
bug
Something isn't working
0 open issues
documentation
Improvements or additions to documentation
0 open issues
duplicate
This already exists
0 open issues
enhancement
New feature or request
0 open issues
good first issue
Good for newcomers
0 open issues
help wanted
Extra attention is needed
0 open issues
question
Further information is requested
0 open issues
wontfix
This will not be worked on
0 open issues