Skip to content

The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]

NameLast commit date
..
adaptive_router_demo
health_check
lens_assets
trace_codegen
auto-close-duplicates.test.ts
auto-close-duplicates.ts
benchmark_anthropic_messages_perf.py
benchmark_chat_completions_perf.py
benchmark_mock.py
benchmark_model_response_creator.py
benchmark_ocr_callbacks.py
benchmark_proxy_vs_provider.py
benchmark_streaming_chunk_overhead.py
build_core_distribution.py
check_mcp_operation_boundary.py
check_mcp_sdk_install.py
check_openapi_docs.py
check_schema_compatibility.py
check_test_quality.py
check_type_discipline.py
classify-issue.test.ts
classify-issue.ts
comment-fixed-issue.test.ts
comment-fixed-issue.ts
create_litellm_branch.ps1
create_litellm_branch.sh
create_team_key_and_submit_guardrail.sh
default_branch.py
eval_compression.py
flag-duplicate-issue.test.ts
flag-duplicate-issue.ts
gate_slot_lock.py
generate_trace_types.py
install_git_hooks.sh
install-cli.sh
install.sh
issue-labels.ts
label-issue.test.ts
label-issue.ts
lint_base_counts.py
mock_bedrock_passthrough_target.py
mock_grayswan_timeout_server.py
mutation_report.py
openapi_docs_gate.py
pre_commit_lint.sh
prisma_generate_if_needed.py
quickstart.ps1
quickstart.sh
ruff_strict_gate.py
seed_request_logs.py
seed_tracing_fixtures.py
sync_together_ai_models.py
sync-issue-labels.test.ts
sync-issue-labels.ts
test_agent_mcp_endpoints.sh
test_guardrails_register_endpoints.sh
test_quality_gate.py
test_tool_allowlist_script.py
tpm_headline_test.sh
type_check_gate.py
type_discipline_gate.py
verify_adaptive_router.py
with_dashboard_node.sh