Skip to content

Run frontier MoE models on hardware you already own — pure C, zero deps, experts streamed from disk. Tiny engine, immense model. 🐦

C

Commits on main

docs(qwen36 tier): 5 GB budget calibration point
kreuzzelg committed 2 months ago
112a53a
Merge pull request #1372 from JustVugg/release/1.10.2
Vincenzo Fornaro committed 2 months ago
d0f1791
9e8eb14
09c1561
4b68d66
b443c51
Merge dev into fix/glm53-kv-slots
JustVugg committed 2 months ago
4c876ab
e950536
68beda4
release: 1.10.2
JustVugg committed 2 months ago
e0ba2c3
6d92751
6176c5b
3a9a3da