The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]
Python ai-gatewayanthropicazure-openaibedrockgatewaylangchainlitellmllmllm-gatewayllmopsmcp-gatewayopenaiopenai-proxyrustrust-aivertex-ai
from dataclasses import dataclass
from pydantic import BaseModel
class Readiness(BaseModel):
status: str = ""
db: str = ""
class ContainerState(BaseModel):
Running: bool
ExitCode: int
@dataclass(frozen=True, slots=True)
class Observation:
exit_code: int | None
ready: bool
@dataclass(frozen=True, slots=True)
class Migration:
name: str
script: str