Run frontier MoE models on hardware you already own β pure C, zero deps, experts streamed from disk. Tiny engine, immense model. π¦
C
site: four model families, not one β and two cards that were plainly wrong
JustVugg3cf82f6472c6
diff --git a/site/index.html b/site/index.htmlindex b253806c..b8bbc04c 100644--- a/site/index.html+++ b/site/index.html@@ -3,10 +3,10 @@<head><meta charset="utf-8"><meta name="viewport" content="width=device-width, initial-scale=1">-<title>colibri β a 744B model on hardware you own</title>-<meta name="description" content="Run GLM-5.2, a 744-billion-parameter Mixture-of-Experts model, on hardware you already own β pure C, zero dependencies, experts streamed from disk.">-<meta property="og:title" content="colibri β a 744B model on hardware you own">-<meta property="og:description" content="A 744B MoE on consumer hardware: pure C, zero dependencies, experts tiered across VRAM, RAM and disk. Run it, study it, improve it.">+<title>colibri β frontier MoE models on hardware you own</title>+<meta name="description" content="Run frontier Mixture-of-Experts models β 744B to 2.8T parameters β on hardware you already own. Pure C, zero dependencies, experts streamed from disk.">+<meta property="og:title" content="colibri β frontier MoE models on hardware you own">+<meta property="og:description" content="Frontier MoE models on consumer hardware, from 744B to 2.8T: pure C, zero dependencies, experts tiered across VRAM, RAM and disk. Run it, study it, improve it."><meta property="og:type" content="website"><meta property="og:image" content="https://raw.githubusercontent.com/JustVugg/colibri/main/docs/media/colibri-atlas.png"><link rel="icon" type="image/svg+xml" href="colibri-icon.svg">@@ -179,10 +179,12 @@ footer li a:hover{color:var(--on-dark)}<header class="hero" id="top"><div class="wrap hero-grid">- <h1>A <u>744-billion-parameter</u> model, running on <u>hardware you own</u></h1>+ <h1>These models do not fit in your machine. <u>They run in it anyway.</u></h1><div class="aside">- GLM-5.2 is a 744B Mixture-of-Experts model. colibri runs it in pure C, with zero dependencies,- by streaming its experts from disk β no cluster, no cloud, no API key.+ A Mixture-of-Experts token touches a small fraction of the weights, so colibri keeps that part+ resident and streams the rest from disk as it is needed. Four families run today β GLM-5.2+ (744B), Inkling (975B), Kimi K3 (2.8T) and OLMoE (7B) β in pure C, with zero dependencies.+ No cluster, no cloud, no API key.<div class="cta"><a class="btn" href="https://github.com/JustVugg/colibri">Star on GitHub</a><a class="btn ghost" href="https://github.com/JustVugg/colibri#quick-start">Quick start β</a>@@ -226,15 +228,15 @@ footer li a:hover{color:var(--on-dark)}<div class="card"><h3>OLMoE</h3><p class="desc">The small research workhorse β quantization A/Bs and quality ablations run here first.</p><div class="meta"><div class="row"><span class="k">Maker</span><span class="v">Allen AI</span></div><div class="row"><span class="k">Size Β· Status</span><span class="v">7B MoE Β· Live</span></div></div><a class="btn" href="https://github.com/JustVugg/colibri">Run it β</a></div>- <div class="card"><h3>Inkling</h3><p class="desc">A 975B reasoning MoE β mixed-precision staging under test to fit a consumer box.</p>- <div class="meta"><div class="row"><span class="k">Maker</span><span class="v">Thinking Machines</span></div><div class="row"><span class="k">Size Β· Status</span><span class="v">975B MoE Β· Planned</span></div></div>- <a class="btn soon">On the roadmap</a></div>+ <div class="card"><h3>Inkling</h3><p class="desc">A 975B reasoning MoE, running today. An int4 dense container brings the resident set to 15.3 GB, so it fits a 25 GB box.</p>+ <div class="meta"><div class="row"><span class="k">Maker</span><span class="v">Thinking Machines</span></div><div class="row"><span class="k">Size Β· Status</span><span class="v">975B MoE Β· Live</span></div></div>+ <a class="btn" href="https://github.com/JustVugg/colibri/blob/main/docs/inkling.md">Run it β</a></div><div class="card"><h3>DeepSeek</h3><p class="desc">A widely-studied frontier MoE family β the tiered engine's next large-scale target.</p><div class="meta"><div class="row"><span class="k">Maker</span><span class="v">DeepSeek AI</span></div><div class="row"><span class="k">Size Β· Status</span><span class="v">671Bβ1T MoE Β· Planned</span></div></div><a class="btn soon">On the roadmap</a></div>- <div class="card"><h3>Kimi K2</h3><p class="desc">The next scale step: a trillion-parameter model on the same tiered engine.</p>- <div class="meta"><div class="row"><span class="k">Maker</span><span class="v">Moonshot AI</span></div><div class="row"><span class="k">Size Β· Status</span><span class="v">1T MoE Β· Planned</span></div></div>- <a class="btn soon">On the roadmap</a></div>+ <div class="card"><h3>Kimi K3</h3><p class="desc">The largest model here, running today β its QAT-trained MXFP4 experts are streamed straight from the original checkpoint, with no conversion.</p>+ <div class="meta"><div class="row"><span class="k">Maker</span><span class="v">Moonshot AI</span></div><div class="row"><span class="k">Size Β· Status</span><span class="v">2.8T MoE Β· Live</span></div></div>+ <a class="btn" href="https://github.com/JustVugg/colibri/blob/main/docs/kimi_k3.md">Run it β</a></div><div class="card"><h3>Qwen3 MoE</h3><p class="desc">The most widely-deployed open family β broad hardware coverage meets broad adoption.</p><div class="meta"><div class="row"><span class="k">Maker</span><span class="v">Alibaba Qwen</span></div><div class="row"><span class="k">Size Β· Status</span><span class="v">MoE Β· Planned</span></div></div><a class="btn soon">On the roadmap</a></div>@@ -296,7 +298,7 @@ footer li a:hover{color:var(--on-dark)}</ul></div><div><h4>Models</h4><ul><li><a href="#models">GLM-5.2</a></li><li><a href="#models">OLMoE</a></li>- <li><a href="#models">Inkling</a></li><li><a href="#models">DeepSeek</a></li>+ <li><a href="#models">Inkling</a></li><li><a href="#models">Kimi K3</a></li></ul></div><div><h4>Project</h4><ul><li><a href="https://github.com/JustVugg/colibri/issues">Issues</a></li>