Skip to content

The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]

NameLast commit date
..
a2a
aiml
aiohttp_openai
anthropic
apiserpent
aws_polly
azure
azure_ai
base_llm
baseten
bedrock
bedrock_mantle
black_forest_labs
brave
bytez
cerebras
chat
chatgpt
clarifai
claude_code
cloudflare
codex
cohere
cometapi
compactifai
crusoe
custom_httpx
dashscope
databricks
dataforseo
datarobot
deepagents
deepgram
deepinfra
deepseek
docker_model_runner
duckduckgo
e2b
edenai
elevenlabs
exa_ai
fal_ai
fastcrw
featherless_ai
firecrawl
fireworks_ai
friendliai
gdc
gemini
gigachat
github_copilot
google_pse
gradient_ai
groq
heroku
hosted_vllm
huggingface
hyperbolic
inception
infinity
jina_ai
lambda_ai
langflow
langgraph
laya
lemonade
linkup
litellm_proxy
llamafile
lm_studio
manus
meta
meta_llama
microsoft_365_copilot
milvus
minimax
mistral
modelscope
mongodb
moonshot
nadir
nebius
neosantara
nimble
nlp_cloud
novita
nscale
nvidia_nim
nvidia_riva
oci
ocr
ollama
oobabooga
openai
openai_like
opencode
openrouter
opensandbox
ovhcloud
parallel_ai
parasail
pass_through
perplexity
pg_vector
pi
publicai
ragflow
recraft
reducto
replicate
runwayml
s3_vectors
sagemaker
sail
sambanova
sap
scaledown
scaleway
searchapi
searxng
serper
snowflake
soniox
stability
strands_decider
tavily
tencent
tinyfish
together_ai
tool_loop
topaz
triton
v0
valkey
vercel_ai_gateway
vertex_ai
vllm
volcengine
voyage
wandb
watsonx
xai
xinference
you_com
zai
__init__.py
test_api_base_trailing_slash_routes.py
test_cache_control_and_reasoning.py
test_custom_llm.py
test_file_content_block.py
test_file_search_responses.py
test_get_complete_url_trailing_slash.py
test_lifecycle_fix.py
test_oss_decision.py
test_polling_url_origin_match.py
test_predibase_transformation.py