Run frontier MoE models on hardware you already own — pure C, zero deps, experts streamed from disk. Tiny engine, immense model. 🐦
C
Commits on main
feat(vulkan): deepseek_v41 builds each chain layer whole in its device-only placement
2c14f7e JustVugg committed 1 month ago
feat(planner): the partial chain's layouts of deepseek_v41 and kimi_k3
8d88c85 JustVugg committed 1 month ago
feat(vulkan): kimi_k3 runs a partial chain: the first N layers on the device
177e39a JustVugg committed 1 month ago
feat(vulkan): deepseek_v41 runs a partial chain: the first N layers on the device
397e09e JustVugg committed 1 month ago
Merge remote-tracking branch 'origin/dev' into feat/vk-staged-import
5460ec8 JustVugg committed 1 month ago
Merge remote-tracking branch 'origin/dev' into feat/vk-tier-exclusive
d4df5d0 JustVugg committed 1 month ago
Merge pull request #1920 from JustVugg/feat/vk-tier-dev2
01f32c0 Vincenzo Fornaro committed 1 month ago
Merge pull request #1919 from JustVugg/feat/shipped-expert-profiles
08311ef Vincenzo Fornaro committed 1 month ago
Merge pull request #1917 from JustVugg/feat/spec-on-by-default
91ef717 Vincenzo Fornaro committed 1 month ago
Merge pull request #1918 from JustVugg/feat/vk-partial-4-glm
3eeb3d0 Vincenzo Fornaro committed 1 month ago
Merge pull request #1916 from JustVugg/feat/vk-partial-3-qwen38
3065054 Vincenzo Fornaro committed 1 month ago
docs(vulkan): staged uploads straight from host memory, COLI_VK_UP_IMPORT and the import fault point
af99bcf JustVugg committed 1 month ago
Merge branch 'feat/vk-tier-exclusive' into feat/vk-staged-import
b237ffb JustVugg committed 1 month ago
vulkan: staged uploads straight from host memory, no copy into the staging buffer
78948c4 JustVugg committed 1 month ago
test(vulkan): the excl cases keep colibri's cache at its slots (CAP_RAISE=0) and leave glm53's count; the usage line names the dev2 families
f71f899 JustVugg committed 1 month ago
tests: the glm53 pin-branch harness with the tier deterministic
e208447 JustVugg committed 1 month ago
test(vulkan), docs: the dev2 families' excl and noexcl cases; exclusive RAM/VRAM in vulkan.md and the environment
cede6c0 JustVugg committed 1 month ago
vk_tier: RAM and VRAM without the same experts when RAM is short (COLI_VK_TIER_EXCLUSIVE)
7c84eee JustVugg committed 1 month ago
tests: the Vulkan families run with speculation off, the cases that test it turn it on
da974b3 JustVugg committed 1 month ago
vulkan: the VK_TEST harness reads the primary device's batch context
9011d1f JustVugg committed 1 month ago
test(vulkan): dev2's glm53 fixture routes four experts: its evict case bounds the second device
3777db2 JustVugg committed 1 month ago
docs(vulkan): a second device for the expert tier, every engine
a8d20d2 JustVugg committed 1 month ago
test(vulkan): the dev2 families, every MoE engine on two devices
48eb26f JustVugg committed 1 month ago
vk_tier: hold experts on a second device too (COLI_VK_DEV2), every engine
fab7a26 JustVugg committed 1 month ago
docs: the shipped expert profiles, and what they do to a first run
d1e2969 JustVugg committed 1 month ago
Merge remote-tracking branch 'origin/dev' into feat/shipped-expert-profiles
34d8a69 JustVugg committed 1 month ago
Merge pull request #1913 from JustVugg/feat/vk-partial-qwen36-olmoe
9eb4389 Vincenzo Fornaro committed 1 month ago
Merge pull request #1909 from JustVugg/feat/vk-partial-chain
8ee260c Vincenzo Fornaro committed 1 month ago
Merge pull request #1904 from JustVugg/fix/1852-v4-expert-wait
119292d Vincenzo Fornaro committed 1 month ago