Skip to content

Run frontier MoE models on hardware you already own — pure C, zero deps, experts streamed from disk. Tiny engine, immense model. 🐦

C

Merge #465: fmt=6 E8/IQ3 lattice container — CPU decode kernel + dispatch (#452 step 3)

Vincenzo Fornaroa0f294b678bb