Run frontier MoE models on hardware you already own — pure C, zero deps, experts streamed from disk. Tiny engine, immense model. 🐦
C
Commits on main
fix(qwen36, olmoe): the chain's pipelines come up after its fit
d769e41 JustVugg committed 1 month ago
test(vulkan): the partial-qwen36-olmoe family, its CI legs and docs
d3334f3 JustVugg committed 1 month ago
feat(olmoe): the matrices resident on the device in the exit line
1bc4c54 JustVugg committed 1 month ago
feat(planner): the partial chain's layouts for qwen36 and olmoe
efd91e5 JustVugg committed 1 month ago
feat(olmoe): a partial dense chain, the first N layers on the device
dc7363e JustVugg committed 1 month ago
feat(qwen36): a partial dense chain, the first N layers on the device
5ca215d JustVugg committed 1 month ago
Merge remote-tracking branch 'origin/dev' into feat/vk-partial-chain
f09256e JustVugg committed 1 month ago
Merge branch 'dev' into fix/windows-async-expert-prefetch
faf198b Vincenzo Fornaro committed 1 month ago
Merge pull request #1901 from JustVugg/feat/vulkan-runtime-memory-speculation
81a4c7f Vincenzo Fornaro committed 1 month ago
Merge branch 'feat/vulkan-runtime-memory-speculation' of https://github.com/JustVugg/colibri into feat/vk-partial-chain
c9b509f JustVugg committed 1 month ago
test(vulkan): fix fixture dependencies and runtime assertions
e649c3d JustVugg committed 1 month ago
build: let the compiler supply the cap test's header prerequisites (#1758)
45d7a10 Jaapjan Tinbergen committed 1 month ago
fix(web): render GFM tables in chat instead of one run-on paragraph
43e5aa8 rayhanhanaputra committed 1 month ago
docs(vulkan): the planner's alignment against a device that aligns more coarsely
acba87d JustVugg committed 1 month ago
docs(vulkan): the partial chain, COLI_VK_CHAIN_LAYERS and COLI_VK_DEVICE_CAP_MB
f15a397 JustVugg committed 1 month ago
test(vulkan): the partial-deepseek family, the template for the other engines
ffdc2e7 JustVugg committed 1 month ago
feat(planner): predict the partial chain's N and credit only its layers
f1d2cdd JustVugg committed 1 month ago
feat(deepseek_v4): a partial dense chain, the first N layers on the device
a201e1f JustVugg committed 1 month ago
feat(vulkan): device memory books, a device cap for tests, and the partial-chain fit
061a9f3 JustVugg committed 1 month ago
test(planner): make Vulkan dense residency checks independent of host hardware
9031259 JustVugg committed 1 month ago
deepseek_v4: measure the expert wait in PROF instead of printing 0 and folding it into attention_s (#1852)
69ba26e JustVugg committed 1 month ago
docs(vulkan): attach repeated MTP measurements and reproducible inputs
1d758d7 JustVugg committed 1 month ago
setup: bring an engine already here up to date with make before using it; coli logs says where a foreground server prints (#1852)
3ece386 JustVugg committed 1 month ago
feat(vulkan): integrate bounded memory, expert streaming and speculative verification
2f33f21 JustVugg committed 1 month ago
fix(windows): prefetch expert files without blocking inference
620f132 JustVugg committed 1 month ago
fix(qwen36): hand qt_init the resolved cap, not the auto sentinel
5e02d2b Jaapjan Tinbergen committed 1 month ago
fix(qwen36): skip RAM-derived cap for dense checkpoints (num_experts 0)
a67674f Jaapjan Tinbergen committed 1 month ago
feat(qwen36): derive the default expert-cache cap from host RAM instead of a hardcoded 16
fca88a8 Jaapjan Tinbergen committed 1 month ago