Skip to content

The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]

NameLast commit date
..
html_forms
__init__.py
test_admin_ui_utils.py
test_auth_cache_invalidation_pubsub.py
test_cache_aware_routing.py
test_cache_codec.py
test_callback_config_validation.py
test_callback_utils.py
test_check_batch_cost.py
test_check_responses_cost.py
test_codex_model_catalog.py
test_config_sync_pubsub.py
test_credential_hydration.py
test_custom_openapi_spec.py
test_debug_utils.py
test_discoverable_model_filter.py
test_encrypt_decrypt_utils.py
test_error_body_call_id.py
test_expired_ui_session_key_cleanup_manager.py
test_get_routes.py
test_http_parsing_utils.py
test_json_merge_patch.py
test_key_rotation_e2e.py
test_key_rotation_integration.py
test_key_rotation_lock.py
test_key_rotation_manager.py
test_load_config_utils.py
test_model_deprecation.py
test_model_listing_utils.py
test_openai_endpoint_utils.py
test_openai_error_payload.py
test_openapi_route.py
test_openapi_schema_compat.py
test_periodic_reload_schedule.py
test_proxy_encrypt_decrypt.py
test_rbac_utils.py
test_realtime_cache.py
test_registry_read_through.py
test_request_tag_mappings.py
test_reset_budget_job.py
test_resource_ownership.py
test_scheduled_job_stagger.py
test_semantic_text_index.py
test_slow_gc_logger.py
test_sse_keepalive.py
test_static_asset_utils.py
test_swagger_utils.py
test_timezone_utils.py
test_token_count_settings.py
test_upsert_budget_membership.py
test_user_api_key_cache.py
test_validation_error_body.py