The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]
Python ai-gatewayanthropicazure-openaibedrockgatewaylangchainlitellmllmllm-gatewayllmopsmcp-gatewayopenaiopenai-proxyrustrust-aivertex-ai
import json
import sys
from typing import Final, LiteralString
from integration._support.database import write_rows
CLEAR_QUERY: Final[LiteralString] = 'DELETE FROM "LiteLLM_ToolTable" WHERE tool_name = %s'
def clear(tool_names: tuple[str, ...]) -> None:
for tool_name in tool_names:
write_rows(CLEAR_QUERY, (tool_name,))
if __name__ == "__main__":
if sys.argv[1] != "clear":
raise SystemExit(f"unknown command: {sys.argv[1]}")
clear(tuple(sys.argv[2:]))
sys.stdout.write(json.dumps({"cleared": sys.argv[2:]}) + "\n")