Skip to content

Run frontier MoE models on hardware you already own — pure C, zero deps, experts streamed from disk. Tiny engine, immense model. 🐦

C

Commits on main

d1c2bca
40abd32
CHANGELOG 1.12.1: #1559
JustVugg committed 1 month ago
2b35814
ed7f535
Merge pull request #1686 from DebugSultan/prefill-batching
Vincenzo Fornaro committed 1 month ago
52be8e1
CHANGELOG 1.12.1: #1691
JustVugg committed 1 month ago
b5944eb
94cef8c
ae48037
f969118
6a25042
62f6a47
86f4567
8ca90cd
3c0b387
f24abbc
9f49a80
2608b0f