Skip to content

Run frontier MoE models on hardware you already own β€” pure C, zero deps, experts streamed from disk. Tiny engine, immense model. 🐦

C

Commits on main

d9d0e7b
51dd480
ARM i8mm: SMMLA fast path for the int8/int4 IDOT drivers
Michael Denyer committed 4 months ago
d0c9941
profile: account expert-disk stall as wait, not other
Michael Denyer committed 4 months ago
da684b2
Merge pull request #259 from withinboredom/uring
Vincenzo committed 4 months ago
dcc1421
3fdc6d3
e871fb7