Skip to content

Run frontier MoE models on hardware you already own — pure C, zero deps, experts streamed from disk. Tiny engine, immense model. 🐦

C

Commits on main

2c6ef58
d93be65
cuda: add native grouped E8 expert kernels
ZacharyZcR committed 3 months ago
a842d50
1584b85
serve: trigger Claude Code system-role fallback
Jacky Jiang committed 3 months ago
7f3b9e7
217c832
test: run tuner fixtures portably
ZacharyZcR committed 3 months ago
a895203
feat: add measured machine autotuning
ZacharyZcR committed 3 months ago
4bc8d0d
docs: clarify compressed tier output semantics
ZacharyZcR committed 3 months ago
a6def3b
cuda: pipeline compressed sidecar loading
ZacharyZcR committed 3 months ago
2e4cd63
docs: document compressed CUDA expert tier
ZacharyZcR committed 3 months ago
3d586d7
cuda: add lossless compressed expert tier
ZacharyZcR committed 3 months ago
8cc534c
Reclaim detached expert arena pages
ZacharyZcR committed 3 months ago
66211fa
ca05b77