Skip to content

Run frontier MoE models on hardware you already own — pure C, zero deps, experts streamed from disk. Tiny engine, immense model. 🐦

C

Commits on main

4653c34
1165bcd
fix(v4): rebuild the unit objects when the build flags change
Marcello Costagliola committed 1 month ago
4e8ef20
30c70ad
CHANGELOG 1.12.1: #1705
JustVugg committed 1 month ago
1f82285
5d6671f
577d8eb
CHANGELOG 1.12.1: #1693, #1695, #1697
JustVugg committed 1 month ago
6035bcd
3fcc7df
78018c3
73dc1f5
6497713
qwen36: keep the prefill echo out of the segment build
Marcello Costagliola committed 1 month ago
8212a39