Skip to content

Run frontier MoE models on hardware you already own — pure C, zero deps, experts streamed from disk. Tiny engine, immense model. 🐦

C

Commits on main

feat(xdna): add prepared host state
Kenneth-Javier Ortigoza committed 3 months ago
838d0bc
feat(xdna): add qualified artifact registry
Kenneth-Javier Ortigoza committed 3 months ago
cd0ca80
feat(xdna): add optional helper runtime binding
Kenneth-Javier Ortigoza committed 3 months ago
cef87a9
feat: expose universal Edge logits
JustVugg committed 2 months ago
c6a7745
update verify_fp8_decode tool
TechPizza committed 2 months ago
157891a
perf: replace ldexpf with arithmetic
TechPizza committed 2 months ago
4db12f6
feat(qwen38): complete bounded prompt runtime
themorlock committed 2 months ago
c50e250
perf(qwen38): overlap native FP8 expert loads
themorlock committed 2 months ago
99deb09
Merge cached origin/dev into feat/qwen38-flash-next
themorlock committed 2 months ago
efcb216
27a5922
feat(glm53): stream the routed experts from disk
JustVugg committed 2 months ago
21bcf68
692af87
Merge branch 'dev' into feat/universal-edge-runtime
Vincenzo Fornaro committed 2 months ago
6305d22
Merge pull request #1251 from JustVugg/refactor/shared-mhc
Vincenzo Fornaro committed 2 months ago
b18cf38
88e275f
build: expose segment edge runtime archive
JustVugg committed 2 months ago
f1986b2