Skip to content

Run frontier MoE models on hardware you already own — pure C, zero deps, experts streamed from disk. Tiny engine, immense model. 🐦

C

Commits on main

tests: 54 loader symbols total (47 + 7)
JustVugg committed 2 months ago
320799f
Merge pull request #1406 from JustVugg/docs/windows-cuda-dll
Vincenzo Fornaro committed 2 months ago
adf009b
aa4629e
1ccee43
cdc9975
c825e28
19d5adb
Merge pull request #1392 from JustVugg/chore/issue-followups
Vincenzo Fornaro committed 2 months ago
9a87749
aeee21e
b5649e6
ci: quote the Qwen3.8 step name too
JustVugg committed 2 months ago
ec6b0d4
ci: quote the step names that carry a colon
JustVugg committed 2 months ago
c710821
df44b87
fix(glm53): release dashboard hit tracking
bherald committed 2 months ago
a1ccc5f
qwen36 tier: drop the unused counter in the placement pricing loop
Courtney Andrew Richardson committed 2 months ago
35fa507
qwen36: free the warmstart int8 copy on ownership, not on format
Courtney Andrew Richardson committed 2 months ago
84e99ab