Run frontier MoE models on hardware you already own — pure C, zero deps, experts streamed from disk. Tiny engine, immense model. 🐦
C
docs(api): OpenAI server supports tool-calling
jeswra4af80725520
diff --git a/docs/api.md b/docs/api.mdindex 2b92bb6e..52c7b605 100644--- a/docs/api.md+++ b/docs/api.md@@ -30,10 +30,12 @@ completion requests support JSON responses, SSE streaming, usage counts,The server is deliberately text-only and serves one generation at a time: the744B model stays in one persistent process, so concurrent HTTP requests queue-instead of loading duplicate model copies. Tools, image/audio input, custom-stop sequences, log probabilities, and token penalties return an explicit error-rather than being silently ignored. The default bind address is localhost; set-`COLI_API_KEY` before exposing the server beyond the machine.+instead of loading duplicate model copies. Tool-calling **is** supported on this+path — pass OpenAI `tools` and (optionally) `tool_choice`, mirroring the+Anthropic endpoint below. Image/audio input, custom stop sequences, log+probabilities, and token penalties return an explicit error rather than being+silently ignored. The default bind address is localhost; set `COLI_API_KEY`+before exposing the server beyond the machine.Browser access from the Vite development server and Tauri local origins isenabled by default. Repeat `--cors-origin https://your-ui.example` to allow