Skip to content

The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]

361 B
Raw Blame
model_list: []
general_settings:
  master_key: os.environ/LITELLM_MASTER_KEY
  database_url: os.environ/DATABASE_URL
  store_model_in_db: true
  disable_model_info_refresh: true
  disable_spend_logs: false
  proxy_batch_write_at: 1
  coordination_redis:
    host: os.environ/REDIS_HOST
    port: os.environ/REDIS_PORT
router_settings:
  disable_cooldowns: true