Skip to content

Run frontier MoE models on hardware you already own — pure C, zero deps, experts streamed from disk. Tiny engine, immense model. 🐦

C

Commits on main

b851427
perf(qwen): batch dense and shared prefill
JustVugg committed 3 months ago
92cde91
fix(k3): reserve checkpoint memory in RAM budget
JustVugg committed 3 months ago
019eaaf
perf(cache): index Inkling and Kimi expert slots
JustVugg committed 3 months ago
60b9c3e
5129f83
f3698b2
7412b94
b53130e
Merge pull request #1178 from TheOptik/pr/fp8-simd-decode
Vincenzo Fornaro committed 3 months ago
a2aba48
perf(dsv4): batch shared experts during prefill
JustVugg committed 3 months ago
a2f9e3f
fix(qwen36): skip discarded final decode
waizuichougou committed 3 months ago
7397156
f663ce5
582693d
65c1bed