Skip to content

The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]

NameLast commit date
..
fixtures
realtime
conftest.py
conversational_matrix.py
LLM_TRANSLATION_COVERAGE_MATRIX.md
passthrough_client.py
responses_helpers.py
sdk_clients.py
structured_output.py
test_anthropic_completion_e2e.py
test_audio_speech_e2e.py
test_audio_transcriptions_e2e.py
test_bedrock_converse_redacted_thinking_e2e.py
test_bedrock_guardrail_config_e2e.py
test_bedrock_kimi_k3_messages_e2e.py
test_bedrock_mantle_output_limit_e2e.py
test_bedrock_native_e2e.py
test_bedrock_provider_matrix_e2e.py
test_bedrock_web_search_server_tool_e2e.py
test_cache_control_injection_tool_calls_e2e.py
test_cache_control.py
test_chat_completion_prediction_e2e.py
test_chat_completions_contract_e2e.py
test_chat_completions_regression_e2e.py
test_chat_mid_conversation_system_e2e.py
test_chat_stream_contract_e2e.py
test_chat_tool_round_trip_e2e.py
test_completions_endpoint_e2e.py
test_containers_e2e.py
test_conversational_matrix_e2e.py
test_count_tokens_source_e2e.py
test_credential_messages_e2e.py
test_custom_pricing_e2e.py
test_deepseek_reasoning_e2e.py
test_embeddings_endpoint_e2e.py
test_files_batches_contract_e2e.py
test_gemini_url_context_e2e.py
test_google_interactions_e2e.py
test_google_native_e2e.py
test_image_edits_e2e.py
test_image_generation_e2e.py
test_messages_azure_foundry_e2e.py
test_messages_bedrock_e2e.py
test_messages_beta_headers_e2e.py
test_messages_count_tokens_bedrock_e2e.py
test_messages_e2e.py
test_messages_mid_conversation_system_e2e.py
test_messages_mid_conversation_system_native_providers_e2e.py
test_messages_prompt_caching_and_tool_search_e2e.py
test_moderations_e2e.py
test_ocr_rust_e2e.py
test_ollama_e2e.py
test_passthrough_e2e.py
test_passthrough_headers_e2e.py
test_provider_features_e2e.py
test_realtime_http_e2e.py
test_reasoning_effort_e2e.py
test_rerank_e2e.py
test_responses_bridge_streaming_e2e.py
test_responses_e2e.py
test_responses_retrieve_e2e.py
test_sagemaker_nova_e2e.py
test_sail_e2e.py
test_together_ai_e2e.py
test_token_counter_gemini_contents_e2e.py
test_vector_stores_e2e.py
test_vertex_capabilities_e2e.py
test_vertex_passthrough_e2e.py