Skip to content

Run frontier MoE models on hardware you already own — pure C, zero deps, experts streamed from disk. Tiny engine, immense model. 🐦

C

Commits on main

886eacf
c54b28d
78ea979
c09fb52
Merge branch 'dev' into fix/metal-i4-gpu-path
Vincenzo Fornaro committed 3 months ago
f08bb08
Merge pull request #1113 from JustVugg/metal-k3-rebase
Vincenzo Fornaro committed 3 months ago
ee5610b
f130c4e
docs: Kimi K3 Metal tuning (M5 Max) + ignore build junk
RDouglasSharp committed 3 months ago
a851e5b
chore: version 1.7.0
JustVugg committed 3 months ago
d0f32d1
Merge pull request #1111 from JustVugg/fix/cuda-syncwarp
Vincenzo Fornaro committed 3 months ago
2b5ae0e
93271fd
Merge pull request #1097 from JustVugg/perf/v4-lanes-default
Vincenzo Fornaro committed 3 months ago
31debb7