Skip to content

Run frontier MoE models on hardware you already own — pure C, zero deps, experts streamed from disk. Tiny engine, immense model. 🐦

C

Commits on main

Merge branch 'fix/advisory-variants' into fix/glm53-f32-want
Marcello Costagliola committed 1 month ago
5c305fe
62c45ee
api: add Qwen3.6 tool calling
GenericRikka committed 1 month ago
2cb51e8
1f9a852
29e3d4f
ccd8d1c
f17b2f3
1794f70
0fb39fd
Merge branch 'dev' into patch-1
Vincenzo Fornaro committed 1 month ago
25d7359
d140af5
6fd47e1
1a39d82
test(planner): run the cgroup fixture tests on Linux only
Léon Avic Simmons committed 2 months ago
78fb318
fix(planner): honor cgroup memory limits
Léon Avic Simmons committed 2 months ago
677b0c5
fix(qwen36): skip CUDA placement offers for qpack
Léon Avic Simmons committed 2 months ago
f2d6499
fix(qwen36): track Metal backend dependency
Léon Avic Simmons committed 2 months ago
041d868
fe19113
c97d1c3
1517776
fix(qwen36): track affine quant header dependency
Léon Avic Simmons committed 2 months ago
370ac9c
307eb99
ab18e37