Run frontier MoE models on hardware you already own — pure C, zero deps, experts streamed from disk. Tiny engine, immense model. 🐦
C
Commits on main
Merge remote-tracking branch 'origin/dev' into feat/prefill-batch-matmuls
f2918a5 JustVugg committed 1 month ago
Merge pull request #1836 from JustVugg/fix/mimo-harness-vulkan-invariance
391b703 Vincenzo Fornaro committed 1 month ago
Merge remote-tracking branch 'origin/dev' into feat/prefill-batch-matmuls
1718525 JustVugg committed 1 month ago
mimo harness: block invariance is a CPU property, skip it under Vulkan
f2a1fd4 JustVugg committed 1 month ago
docs: prefill projections per block of rows, what they do on the 780M
54cfa2f JustVugg committed 1 month ago
Merge pull request #1835 from JustVugg/feat/mimo-brio
79d77b7 Vincenzo Fornaro committed 1 month ago
Merge pull request #1834 from JustVugg/feat/vulkan-gemm
437612f Vincenzo Fornaro committed 1 month ago
deepseek_v4: the device gets a prefill chunk's router, compressor and index queries at once
10a52b8 JustVugg committed 1 month ago
kimi_k3: project the DSA index keys of a prefill chunk at once
3f0bc3b JustVugg committed 1 month ago
glm53: a matrix on the Vulkan device takes all of a prefill's rows at once
e5e75de JustVugg committed 1 month ago
Merge remote-tracking branch 'origin/dev' into feat/mimo-brio
afbd2ec JustVugg committed 1 month ago
deepseek_v41: project per block of positions where prefill went one at a time
a39b3f9 JustVugg committed 1 month ago
gateway: logprobs reach mimo; mimo's tool-call parse reports its maps
a6893d0 JustVugg committed 1 month ago
mimo: Brio mode -- logprobs read-out, pin photos with the window rings
3b800e2 JustVugg committed 1 month ago
mimo: a prefill row no longer depends on the rows that share its block
6cf7910 JustVugg committed 1 month ago
Merge pull request #1833 from JustVugg/docs/readme-site-release
2b002f4 Vincenzo Fornaro committed 1 month ago
Merge remote-tracking branch 'origin/dev' into feat/vulkan-gemm
9232d4a JustVugg committed 1 month ago
qwen36: project the DeltaNet inputs and outputs per block of rows
960e2a4 JustVugg committed 1 month ago
docs: the Vulkan prefill GEMMs, their knobs and what they measure on a 780M
d25f75a JustVugg committed 1 month ago
vulkan: drop the matmul binding cache when a scratch buffer regrows
88f40ff JustVugg committed 1 month ago
Merge remote-tracking branch 'origin/dev' into docs/readme-site-release
918c69b JustVugg committed 1 month ago
Merge pull request #1832 from JustVugg/feat/qwen38-mtp
1755ff9 Vincenzo Fornaro committed 1 month ago
docs(zh-TW): README.zh-TW.md carries every section of the English README
dc924d4 JustVugg committed 1 month ago
docs(zh-CN): README.zh-CN.md carries every section of the English README
6febb91 JustVugg committed 1 month ago