Skip to content

Run frontier MoE models on hardware you already own — pure C, zero deps, experts streamed from disk. Tiny engine, immense model. 🐦

C

Commits on main

fix(tests): guard test_olmoe_dot_i8_16_sse41 to x86_64 too
Jaapjan Tinbergen committed 2 months ago
a00a5c4
docs: connect pi coding agent to coli serve
Tetsuo Koyama committed 2 months ago
1f35371
fix(olmoe): move converter from GLM to OLMoE descriptor
yeduwuren2026 committed 2 months ago
41cb9a0
5a0b725
a536d96
e9a650b
f02c202
e17dbb2
fix: stage v41_dsml.py during installation
John Titor committed 2 months ago
f17b3ae
d548042
qwen36: port CACHE_ROUTE with the VRAM tier as the first residency level
Courtney Andrew Richardson committed 2 months ago
ec99181
119266e
vulkan: keep the VK_TEST harness clean under synchronization validation
Courtney Andrew Richardson committed 2 months ago
2b1e814
vulkan: free the qprep scratch and per-layer norm buffers at shutdown
Courtney Andrew Richardson committed 2 months ago
39b3832
998c800