Skip to content

Run frontier MoE models on hardware you already own — pure C, zero deps, experts streamed from disk. Tiny engine, immense model. 🐦

C

Commits on main

9c0c6bc
fix(cuda): unwind failed Qwen tier initialization
ZacharyZcR committed 1 month ago
fe29def
e9c45f6
1d6bfe2
81bbae1
0977650
25507df
9d1c441
cuda: reuse SiTU expert staging across calls
ZacharyZcR committed 1 month ago
ba5ca29
qwen36: batch resident DeltaNet input projections
ZacharyZcR committed 1 month ago
0fc47cc
d99dc06
cc27d98
a65ea15
8e8447c
cuda: reuse streaming MXFP4 weight scratch
ZacharyZcR committed 1 month ago
b6ac01e
Merge origin/dev into perf/qwen38-idot-trunk
JustVugg committed 2 months ago
0d8dd39
42f640d
Merge pull request #1650 from bokiko/fix/qwen38-stale-pin
Vincenzo Fornaro committed 2 months ago
8d546fa
71622eb
6c78834