Run frontier MoE models on hardware you already own — pure C, zero deps, experts streamed from disk. Tiny engine, immense model. 🐦
C
Commits on main
Merge pull request #1911 from JustVugg/fix/1908-vk-dev-coop-stride
31c3388 Vincenzo Fornaro committed 1 month ago
Merge pull request #1912 from JustVugg/fix/dho-inkling-bf16-runners
31e1e5e Vincenzo Fornaro committed 1 month ago
Merge pull request #1903 from JustVugg/fix/1852-setup-rebuild-logs
987c2bd Vincenzo Fornaro committed 1 month ago
Merge pull request #1914 from JustVugg/fix/ci-windows-timeout
a3d34d5 Vincenzo Fornaro committed 1 month ago
setup: ship a starting expert history for Qwen3.6 and Qwen3.8
193431c JustVugg committed 1 month ago
tests: the speculative harnesses start every run from both draft sources off
0722320 JustVugg committed 1 month ago
speculative decoding on by default: Qwen3.8's MTP head and prompt lookup, gated; the plan prices the MTP head
1524528 JustVugg committed 1 month ago
Merge branch 'feat/vk-partial-3-qwen38' into feat/vk-partial-4-glm
d18dcab JustVugg committed 1 month ago
Merge branch 'feat/vk-partial-qwen36-olmoe' into feat/vk-partial-3-qwen38
a1029cf JustVugg committed 1 month ago
tests: partial-qwen36-olmoe runs olmoe's brio serve class only
49a5aee JustVugg committed 1 month ago
tests: dense-only inkling's bf16 fixture on a CPU with a bf16 dot (the red dev runs)
a9d204b JustVugg committed 1 month ago
Merge pull request #1902 from JustVugg/fix/windows-async-expert-prefetch
cc96b38 Vincenzo Fornaro committed 1 month ago
vulkan: COLI_VK_DEV picks the device; the coop GEMM's epilogue stride aligned to 16 bytes (#1908)
674d451 JustVugg committed 1 month ago
test(vulkan): partial-glm's chunks within the bound on glm53, a declined verify, docs
f5e79e8 JustVugg committed 1 month ago
fix(vulkan): the GLM fits before the chain's pipelines, coli plan cross-checked
e206e74 JustVugg committed 1 month ago
docs(vulkan): qwen38's example lines under the cap the fit-first engine prints them for
cf38167 JustVugg committed 1 month ago
fix(planner): no qwen38 prediction on a device whose memory is unknown
418e0aa JustVugg committed 1 month ago
fix(qwen38): fit before the chain's pipelines, coli plan's numbers in the family
42f9d86 JustVugg committed 1 month ago
test(vulkan): the partial-qwen38 family, its sanitize variant and their CI legs
822d451 JustVugg committed 1 month ago
feat(qwen38): a partial dense chain, the first N layers on the device
8ec52be JustVugg committed 1 month ago