Skip to content

Never stop coding. Free MIT AI gateway: one endpoint, 375 providers (150+ free), 1,400+ models Kimi, Claude, GPT, Gemini, GLM, DeepSeek, MiniMax. Works with Claude Code, Codex, Cursor, OpenCode, Cline & Copilot. Quota-aware auto-fallback, RTK+Caveman compression saves 15-95% tokens, MCP/A2A, Desktop/PWA. Built by 900+ contributors

958 B
Raw Blame
###
# @name List model directly from llama-cpp provider
GET http://{{llama-address}}/v1/models
Authorization: Bearer {{LLAMACPP_API_KEY}}

###
# @name List all models
GET {{omniroute-address}}/models
Authorization: Bearer {{OMNIROUTE_API_KEY}}
Content-Type: application/json

###
# @name Send a standard OpenAI chat request directly to llama-cpp provider
POST http://{{llama-address}}/chat/completions
Authorization: Bearer {{LLAMACPP_API_KEY}}

{
  "model": "unsloth/gemma-4-26B-A4B-it-GGUF:UD-IQ2_M",
  "stream": true,
  "messages": [
    {
      "role": "user",
      "content": "Tell me a joke."
    }
  ]
}

###
# @name Send a standard OpenAI chat request to this llama-cpp provider
POST {{omniroute-address}}/v1/chat/completions
Authorization: Bearer {{OMNIROUTE_API_KEY}}

{
  "model": "llamacpp/unsloth/gemma-4-26B-A4B-it-GGUF:UD-IQ2_M",
  "stream": true,
  "messages": [
    {
      "role": "user",
      "content": "Tell me a joke."
    }
  ]
}
###