Skip to content

Run frontier MoE models on hardware you already own — pure C, zero deps, experts streamed from disk. Tiny engine, immense model. 🐦

C

Merge #497: narrow the LFRU eviction guard so speculations don't over-drop (fixes #490)

Vincenzo Fornaro700532d4ed2e