Skip to content

Run frontier MoE models on hardware you already own — pure C, zero deps, experts streamed from disk. Tiny engine, immense model. 🐦

C

Merge #477: vectorize MLA absorption helpers (qt_addrow/qt_matvec_rows) — +13% decode AVX-512, byte-identical

Vincenzo Fornarob86cc1d04dfb