Skip to content

The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]

NameLast commit date
..
azure_client_usage_test.py
ban_constant_numbers.py
ban_copy_deepcopy_kwargs.py
bedrock_pricing.py
callback_manager_test.py
check_data_replace_usage.py
check_e2e_no_raw_requests.py
check_endpoint_coverage.py
check_fastuuid_usage.py
check_get_model_cost_key_performance.py
check_guardrail_apply_decorator.py
check_licenses.py
check_migrations_lock_timeout.py
check_migrations_no_data_rewrites.py
check_no_publicly_known_master_key.py
check_prisma_binary_cache.py
check_provider_folders_documented.py
check_py310_typing_imports.py
check_spanattributes_value_usage.py
check_telemetry_imports.py
check_unbounded_in_lists.py
check_unsafe_enterprise_import.py
check_workflow_job_name_collisions.py
check_workflow_startup_safety.py
code_qa_check_tests.py
enforce_llms_folder_style.py
ensure_async_clients_test.py
info_log_check.py
liccheck.ini
license_cache.json
litellm_logging_code_coverage.py
log.txt
memory_test.py
prevent_key_leaks_in_exceptions.py
recursive_detector.py
router_code_coverage.py
router_enforce_line_length.py
test_aio_http_image_conversion.py
test_ban_set_verbose.py
test_chat_completion_imports.py
test_check_no_publicly_known_master_key.py
test_e2e_idp_stack.py
test_e2e_junit_report.py
test_e2e_metadata.py
test_merge_smoke.py
test_no_hardcoded_secrets.py
test_provider_cache.py
test_provider_replay_harness.py
test_proxy_types_import.py
test_router_strategy_async.py
test_unit_passed_gate.py
test_workflow_job_name_collisions.py
unbounded_in_baseline.txt