Skip to content

Run frontier MoE models on hardware you already own — pure C, zero deps, experts streamed from disk. Tiny engine, immense model. 🐦

C

Commits on main

0c4a751
Merge branch 'dev' into vulkan-moltenvk-xbatch
Vincenzo Fornaro committed 1 month ago
6325996
b9180a4
olmoe: take a prompt's MoE expert by expert, the same bits
Marcello Costagliola committed 1 month ago
794d0c0
Merge branch 'dev' into vulkan-moltenvk-xbatch
Vincenzo Fornaro committed 1 month ago
574c498
Merge branch 'dev' into fix/dsv41-engram-bounds
Vincenzo Fornaro committed 1 month ago
1f6889c
ff12462