Skip to content

Run frontier MoE models on hardware you already own — pure C, zero deps, experts streamed from disk. Tiny engine, immense model. 🐦

C

Commits on main

4521832
64aa29b
1b0dd1b
Merge pull request #1820 from JustVugg/docs/mimo-bench
Vincenzo Fornaro committed 1 month ago
d19234c
Merge pull request #1819 from JustVugg/fix/mimo-caps
Vincenzo Fornaro committed 1 month ago
6444917
3ff4cd6
1ba5b09
fix(olmoe): limit low-RAM floor to macOS
Cometbuster4969 committed 1 month ago
4c40866
docs/mimo: measured on an idle machine
JustVugg committed 1 month ago
dee21ad
Merge branch 'dev' into build/makefile-autodeps
Kenneth-Javier Ortigoza committed 1 month ago
d00ad2f
15641cf
1ca2398
024dd03
Merge pull request #1761 from mfethe1/neon-fp8-batch
Vincenzo Fornaro committed 1 month ago
47f3569
2ee1d2f
Merge branch 'dev' into fix/dsv4-shared-expert-bindings
Vincenzo Fornaro committed 1 month ago
932c287
Merge pull request #1813 from JustVugg/feat/mimo
Vincenzo Fornaro committed 1 month ago
af7f02c