Run frontier MoE models on hardware you already own — pure C, zero deps, experts streamed from disk. Tiny engine, immense model. 🐦
C
Commits on main
Merge pull request #1924 from JustVugg/feat/vk-tier-exclusive
0405e10 Vincenzo Fornaro committed 1 month ago
Merge pull request #1923 from JustVugg/feat/vk-partial-6-imk
ed8b2b2 Vincenzo Fornaro committed 1 month ago
Merge pull request #1922 from JustVugg/feat/vk-partial-5-dsk
24b07e3 Vincenzo Fornaro committed 1 month ago
Merge branch 'feat/vk-tier-exclusive' into feat/vk-staged-import
b1408d9 JustVugg committed 1 month ago
tests: glm53's pin-branch harness compares within 1e-5 through the Vulkan chain
180cdae JustVugg committed 1 month ago
vulkan: a split KV cache takes prompt chunks of half the window
fc6e4aa JustVugg committed 1 month ago
Merge branch 'feat/vk-tier-exclusive' into feat/vk-staged-import
c7767c6 JustVugg committed 1 month ago
Merge branch 'feat/vk-partial-5-dsk' into feat/vk-partial-6-imk
5dafa7b JustVugg committed 1 month ago
tests: inkling-mimo's partial-chain helpers carry their own prefix; a sourced group script may not redefine a function
a62d4d9 JustVugg committed 1 month ago
ci: dev2-sanitize keeps its requirements (a merge of dev had dropped them)
f4ab77d JustVugg committed 1 month ago
docs: qwen38's MTP head on the tier, in its engine page and environment entry
2cbeb9d JustVugg committed 1 month ago
ci: the partial-inkling-mimo families install the oracle requirements (Inkling's fixture needs torch), as dense-only-inkling-mimo-kimi does
c74bb85 JustVugg committed 1 month ago
vulkan: the drafting heads' experts on the tier for colibri and deepseek_v41
e7f363f JustVugg committed 1 month ago
tests: the staged-import probe runs in staged_window (qwen-staged), whose job has the fixture dependencies
37d8063 JustVugg committed 1 month ago
vulkan: the MTP head's experts on the tier (qwen38), in a pool of their own
17fae83 JustVugg committed 1 month ago
Merge branch 'feat/vk-tier-exclusive' into feat/vk-staged-import
c014722 JustVugg committed 1 month ago
exclusive RAM/VRAM: build without Vulkan, and the victim tests' new arguments
5627851 JustVugg committed 1 month ago
vulkan: inkling's and MiMo's head failing to go up keeps every layer on the device
bec7030 JustVugg committed 1 month ago
docs(vulkan): coli plan's partial-chain prediction for inkling and MiMo
4eadda0 JustVugg committed 1 month ago
test(vulkan): the cap helper's pools at the new cap, and coli plan beside the engines
ce741e8 JustVugg committed 1 month ago
test(vulkan): partial-inkling-mimo, inkling's and MiMo's partial chain on Lavapipe
428a0e8 JustVugg committed 1 month ago
feat(vulkan): MiMo's partial dense chain, the first N layers on the device
b3210a6 JustVugg committed 1 month ago
feat(vulkan): inkling's partial dense chain, the first N layers on the device
35ad8a4 JustVugg committed 1 month ago
test(vulkan): Kimi K3's device-only upload failure keeps one host copy and every layer
aa6fe73 JustVugg committed 1 month ago
test(vulkan): partial-dsk's prompts-only device-only Kimi case reads each device MLA layer's kv_b back once
8d319de JustVugg committed 1 month ago