Skip to content

Run frontier MoE models on hardware you already own — pure C, zero deps, experts streamed from disk. Tiny engine, immense model. 🐦

C

Commits on main

8696e2a
046f604
15e4b4e
perf(tune): measure safe RAM and cache caps
JustVugg committed 2 months ago
a55336e
ae67e8d
ad53e35
Merge pull request #1207 from ZacharyZcR/feat/kv8-scale128
Vincenzo Fornaro committed 2 months ago
21c2ec6
eec2a43
38daecf
e9455df
80b11dc
6896e5f
929e99b
5e4b247
6a37a54
a774efd
3d0bab1
a3d11c2
b0c6805
Merge pull request #1194 from JustVugg/feat/k3-ckpt-disk
Vincenzo Fornaro committed 3 months ago
8107f53