Skip to content

Run frontier MoE models on hardware you already own — pure C, zero deps, experts streamed from disk. Tiny engine, immense model. 🐦

C

Commits on main

perf(dsv4): coalesce duplicate expert loads
JustVugg committed 3 months ago
95e1aa3
176a493
Merge pull request #1160 from JustVugg/ci/metal-compile-gate
Vincenzo Fornaro committed 3 months ago
2c45694
d3960da
Merge pull request #1151 from ZacharyZcR/feat/kv8-rebase
Vincenzo Fornaro committed 3 months ago
a7fb0ca
1b757b9
ffd3eb7
Merge pull request #1152 from JustVugg/fix/inkling-metal-qgs
Vincenzo Fornaro committed 3 months ago
eb7c946
2325776
Merge pull request #1134 from tonnthuir/fix/rss-guard-trim
Vincenzo Fornaro committed 3 months ago
95079d9
701bc98
5126616
e573b53
2856210
6ce6858
feat(kimi_k3): wire up tool calling end to end
ZacharyZcR committed 3 months ago
4fe029b
833087b
Merge branch 'dev' into fix/datapoint-v4-parsing
Vincenzo Fornaro committed 3 months ago
532d958
61d7727
Merge pull request #1142 from ZacharyZcR/fix/768-kvb-flash
Vincenzo Fornaro committed 3 months ago
0321b9e