Run frontier MoE models on hardware you already own — pure C, zero deps, experts streamed from disk. Tiny engine, immense model. 🐦
C
Commits on main
vulkan chain: causal attention of a prompt chunk on the matrix units
d9821e5 huppiflupp committed 1 month ago
vk: GLM-5.2 layers on two devices; inkling reports a lost second device at setup
23c5149 JustVugg committed 1 month ago
olmoe, mimo: a step the second device loses is redone from the rows as they came in
e9e7c45 JustVugg committed 1 month ago
olmoe: the chain's layers on two devices (COLI_VK_DEV2); qwen38: a lost device at the parameter upload says so
27676d3 JustVugg committed 1 month ago
Merge branch 'integ/release-batch-4' into integ/release-batch-5
31b3621 JustVugg committed 1 month ago
Merge remote-tracking branch 'origin/fix/hardening-2026-10' into integ/release-batch-4
9ea5db1 JustVugg committed 1 month ago
vulkan: the chain's context per device (vkc_device), for layers on COLI_VK_DEV2
fb79bda JustVugg committed 1 month ago
vulkan: the split KV cache's host part on the device (COLI_VK_KV_COLD=device)
323da5a JustVugg committed 1 month ago
docs: drop a zero-width space inside a tool_call tag in api.md
81b2ee5 JustVugg committed 1 month ago