Run frontier MoE models on hardware you already own — pure C, zero deps, experts streamed from disk. Tiny engine, immense model. 🐦
C
release: 1.12.0
JustVuggab2ffd3db0f0
diff --git a/CHANGELOG.md b/CHANGELOG.mdindex 0e1754b3..4e992f45 100644--- a/CHANGELOG.md+++ b/CHANGELOG.md@@ -3,6 +3,134 @@All notable changes to colibrì are documented here.Format follows [Keep a Changelog](https://keepachangelog.com/).+## [1.12.0] — 2026-09-20++81 pull requests since v1.11.0. A new way to ask a model a closed question,+a redesigned dashboard and landing page, and a long run of small failures+that used to answer 500 or die on a locale.++### Brio mode: score a closed set instead of generating++- **#1632**: brio mode, on all nine engines. Hand the engine the options an+ answer is allowed to take and it reports the probability of each one+ instead of writing the answer: the option tokens are read, not sampled,+ so `completion_tokens` is 0 and no reply can fall outside the list. It is+ opt-in per request through two `SUBMIT` keys, `logprobs=k` and `pin=1`;+ without them every frame is byte-identical to before, which is asserted+ per engine rather than claimed. `max_tokens=0` became legal, but only+ together with `logprobs>0`.+- The shared contract is three headers: `decode_batch.h` for the logprob+ tail, `serve_codec.h` for the wire, and `pin_pool.h` for nested state+ snapshots, so a request can keep one photograph of the shared+ instructions and a deeper one of the instructions plus the question. With+ one level the question is re-read once per option; with two, four items+ cost 176 tokens instead of 496.+- `kv_prefix_holds()` is the guard that makes the snapshots safe: a+ snapshot is reused only when the prefix record still holds the same ids,+ because a K/V bank can be dropped between two options.+- Exactness is measured, not asserted: the logprobs read from a snapshot+ match a cold recomputation to 0.00e+00 on all nine tiny fixtures, and on+ the two real checkpoints available (qwen36 at 22 GB and DeepSeek V4.1+ Flash at 476 GB).+- Three clients: `POST /v1/brio` on the gateway, `/brio` in `coli chat`,+ and a page in the dashboard. `docs/brio.md` has the request, the reply,+ the normalisation choice and the cases where the mode does not help.++### The dashboard and the landing page++- **#1633**: the web dashboard is redesigned around a workspace and a+ navigation dock, with a brio page that reads a document once and asks it+ several questions, each with its own option set, and a light and dark+ theme.+- **#1635**: the landing page lists the models as a searchable list instead+ of a card grid, gains a brio section, and gets a light and dark theme+ built on the mechanism proposed in #1551. The shipping version and the+ family names are generated from `c/version.py` and `c/family_registry.py`,+ so the page cannot claim eight families again while nine are running.+ The hero plays a recorded session rather than a mock-up.++### Performance++- **#1477**: one routed-expert kernel, `expert_ffn.h`, shared by the MoE+ engines and used by qwen36 first: int4 kept planar in RAM instead of+ unpacked to int8, and two OpenMP regions per layer instead of three per+ expert. 12.8 to 15.7 tok/s with the resident set down from 29 to 17 GB,+ output identical.+- **#1424**: a CUDA VRAM tier for Qwen3.8-Flash-Next, 43 % on one 8 GB card+ and 60 % on two.+- **#1553** and **#1558**: the previous turn's KV is reused instead of+ re-prefilling the transcript, on qwen36, olmoe and DeepSeek V4.1, with a+ resumed prefill that is exact.+- **#1521** and **#1524**: the mHC mix and the KDA convolution and head+ loops run in parallel, bit-identical, for 3.9 % and 3.0 %.+- **#1517**: the four engines that never sized their OpenMP team now do.+- **#1522**: the DeepSeek V4.1 expert stream can be read from more than one+ drive; **#1455** weights glm53 expert reads by disk and honours+ `COLI_MODEL_MIRROR`; **#1543** fixes the V4 mirror cache on unified memory.+- **#1495**: less overhead in the sparse router's top-K selection.++### Fixed++- Requests that answered `500 engine failed` and now answer properly:+ a non-object `json_schema` (**#1587**), an unpaired surrogate escape+ (**#1589**), a non-object `tool_choice.function` (**#1598**), and a tool+ call whose arguments are not an object.+- **#1595**: the grammar draft walker switched itself off after about sixty+ repetitions. **#1596**: a nested array schema doubled the compiled+ grammar at every level.+- **#1483** and **#1514**: olmoe, inkling and glm53 refuse an over-long+ prompt with `CONTEXT_EXCEEDED` instead of failing late.+- **#1549**: the lazy shard-mapping table in `st.h` was published without+ synchronisation and glm53 reached it from an OpenMP region.+- **#1557**: a truncated multibyte tail made the qwen36 tokenizer read past+ the prompt. **#1530**: an integer overflow check in `kimi_k3.c`.+- **#1631**: `coli serve` reaches the expert-history save when it is stopped+ with SIGTERM, not only on Ctrl-C. **#1628**: the expert grid is resent+ after every turn, so the dashboard stops showing the cold snapshot+ forever.+- **#1608**: `coli doctor` matches core tensor roles by component instead of+ by one family's spelling.+- **#1526**, **#1584**, **#1585**, **#1536**: the planner, the auto-tuner+ and the registry agree about which engine is running, and stop advising+ GLM-only knobs on every family.+- **#1489**: `coli bench` ran the GLM engine on any model. **#1503**: every+ engine is handed its model directory through `SNAP`. **#1486** and+ **#1488**: a directory without `config.json` names no engine, and+ `coli convert` refuses an output directory that already holds one.++### Windows, macOS and locales++- **#1515**, **#1560**, **#1561**, **#1562**, **#1516**: the chat, `coli+ run`, `coli tune` and the datapoint harness no longer die when an engine+ line, a prompt or a dash does not fit the console code page.+- **#1537**, **#1579**, **#1535**: the qwen36 CUDA_DLL build on Windows gets+ its tier, is recognised, and the device probe loads the backend before+ counting devices. **#1563**: the Inkling dense int4 converter finishes.+- **#1599**: MacPorts libomp built every macOS engine single-threaded.+ **#1548**: Metal falls back to `MTLCopyAllDevices` when there is no+ system default device. **#1504**: olmoe measures available RAM on macOS+ and Windows too.++### Diagnostics++- **#1494**, **#1506**, **#1512**: `PROF` reports block time, head time,+ matmul, attention and lm_head, at microsecond resolution, on deepseek_v4,+ olmoe and qwen36. **#1555**: `CONSIST=1` checks prefill against decode.+- **#1482**: configurable generation statistics in `coli chat`, with exact+ token throughput when the server reports it.+- **#1468**, **#1487**, **#1480**: a failure in the MoE step, a missing core+ tensor and duplicate tensor names are diagnosed by name instead of by a+ generic message.++### Docs and licence++- **#1540** and **#1541**: the copyright holder is named and a `NOTICE` file+ is added.+- **#1294**: a reproducible benchmarking protocol; **#1508**: a GPU-backend+ datapoint needs a correctness line to be accepted.+- **#1471** and **#1473**: the expired Discord invite is replaced in all+ four READMEs and on the site.+## [1.11.0] — 2026-09-1356 pull requests since v1.10.2. A ninth model family, five real bugs closeddiff --git a/README.it.md b/README.it.mdindex 3d1b204d..8c7e6385 100644--- a/README.it.md+++ b/README.it.md@@ -34,7 +34,7 @@ ma non ridefinire il modello di nascosto.```$ ./coli chat- 🐦 colibri v1.11.0 — GLM-5.2 · 744B MoE · int4 · streaming CPU+ 🐦 colibri v1.12.0 — GLM-5.2 · 744B MoE · int4 · streaming CPU✓ ready in 32s · resident 9.9 GB› ciao!◆ Ciao! 😊 Come posso aiutarti oggi?diff --git a/README.md b/README.mdindex d8460f65..2c3205df 100644--- a/README.md+++ b/README.md@@ -40,7 +40,7 @@ may reduce speed; it must not quietly redefine the model.```$ ./coli chat- 🐦 colibri v1.11.0 — GLM-5.2 · 744B MoE · int4 · streaming CPU+ 🐦 colibri v1.12.0 — GLM-5.2 · 744B MoE · int4 · streaming CPU✓ ready in 32s · resident 9.9 GB› ciao!◆ Ciao! 😊 Come posso aiutarti oggi?diff --git a/README.zh-CN.md b/README.zh-CN.mdindex 75135cd7..21bb12bc 100644--- a/README.zh-CN.md+++ b/README.zh-CN.md@@ -25,7 +25,7 @@ Colibrì 刻意用于验证激进的系统思路——因此**对速度不作 SL```$ ./coli chat- 🐦 colibri v1.11.0 — GLM-5.2 · 744B MoE · int4 · streaming CPU+ 🐦 colibri v1.12.0 — GLM-5.2 · 744B MoE · int4 · streaming CPU✓ ready in 32s · resident 9.9 GB› ciao!◆ Ciao! 😊 Come posso aiutarti oggi?diff --git a/README.zh-TW.md b/README.zh-TW.mdindex 7e484787..1ab674ca 100644--- a/README.zh-TW.md+++ b/README.zh-TW.md@@ -25,7 +25,7 @@ Colibrì 刻意用於驗證激進的系統構想——因此**對速度不作 SL```$ ./coli chat- 🐦 colibri v1.11.0 — GLM-5.2 · 744B MoE · int4 · streaming CPU+ 🐦 colibri v1.12.0 — GLM-5.2 · 744B MoE · int4 · streaming CPU✓ ready in 32s · resident 9.9 GB› ciao!◆ Ciao! 😊 Come posso aiutarti oggi?diff --git a/c/version.py b/c/version.pyindex fe23c815..58ab5498 100644--- a/c/version.py+++ b/c/version.py@@ -1,3 +1,3 @@"""Single source of truth for the colibri version number."""-__version__ = "1.11.0"+__version__ = "1.12.0"diff --git a/site/index.html b/site/index.htmlindex 32178d7f..292ba59c 100644--- a/site/index.html+++ b/site/index.html@@ -488,7 +488,7 @@ footer{border-top:1px solid var(--line)}<footer><div class="fin"><span>© 2026 colibri</span>- <span>Currently shipping <b>v1.11.0</b></span>+ <span>Currently shipping <b>v1.12.0</b></span><span class="sp"><a href="https://github.com/JustVugg/colibri/">GitHub</a><a href="https://github.com/JustVugg/colibri/blob/main/docs/quickstart.md">Docs</a><a href="https://github.com/JustVugg/colibri/blob/main/docs/brio.md">Brio</a><a href="https://github.com/JustVugg/colibri/blob/main/docs/api.md">API</a>