Skip to content

Run frontier MoE models on hardware you already own — pure C, zero deps, experts streamed from disk. Tiny engine, immense model. 🐦

C

Commits on main

87d4d98
3e9af13
71f921b
docs(api): map tool calling support by engine
Mario Gutierrez committed 3 months ago
2487342
e27c37e
fix(mirror): recognize Kimi K3 expert shards
Mario Gutierrez committed 3 months ago
d1653ca
Merge origin/dev into fix/v4-usage-route-trace
Mario Gutierrez committed 3 months ago
efce7a9
7072c04
345bc6c
a35e30a
Merge pull request #947 from gouravkargwal/ci/metal-test
Vincenzo Fornaro committed 3 months ago
7065f20
e53018c
Merge pull request #1022 from JustVugg/dev
Vincenzo Fornaro committed 3 months ago
6546cdd
5ca9161