Run frontier MoE models on hardware you already own — pure C, zero deps, experts streamed from disk. Tiny engine, immense model. 🐦
C
Commits on main
tests(qwen36): test_qwen36_dn_gpu, the DeltaNet layer on the card against the CPU path
7871ed6 kreuzzelg committed 1 month ago
qwen36: Q36_DN_GPU=1, decode tokens run the DeltaNet layer on the GPU end to end
237cfab kreuzzelg committed 1 month ago
deepseek_v41: the dense chain on the device (COLI_VK_CHAIN=1)
ee67d91 JustVugg committed 1 month ago
qwen36 tier: qt_dn_gpu_*, the DeltaNet layer joins its two projections on the card
16f47f0 kreuzzelg committed 1 month ago
backend: the gated delta layer on the device (coli_cuda_dn_*)
34fdc4a kreuzzelg committed 1 month ago
Merge remote-tracking branch 'origin/dev' into fix/setup-igpu-measured
6dfb390 JustVugg committed 1 month ago
Merge pull request #1851 from JustVugg/feat/vk-chain-mla
fe744f4 Vincenzo Fornaro committed 1 month ago
Merge remote-tracking branch 'origin/dev' into feat/vk-chain-mla
825e653 JustVugg committed 1 month ago
Merge remote-tracking branch 'origin/dev' into fix/setup-igpu-measured
811c04c JustVugg committed 1 month ago
glm53: keep the KV prefix across image requests by keying the picture
3213dd9 Léon Avic Simmons committed 1 month ago
Merge pull request #1849 from JustVugg/feat/vk-chain-ink-olmoe
de4451e Vincenzo Fornaro committed 1 month ago
vulkan: Kimi K3's attention residuals, SiTU-GLU and KDA order on the chain
0b60e0f JustVugg committed 1 month ago
Merge remote-tracking branch 'origin/dev' into feat/vk-chain-ink-olmoe
5d719df JustVugg committed 1 month ago
setup: on an integrated GPU, Vulkan only where it was measured faster
f882010 JustVugg committed 1 month ago
Merge pull request #1848 from JustVugg/feat/vk-chain-mimo
05bb2fb Vincenzo Fornaro committed 1 month ago
colibri, glm53: the shared chain decision; lost devices counted from the end
9a73502 JustVugg committed 1 month ago
vulkan: a chain default for engines not measured on an integrated GPU
42a698f JustVugg committed 1 month ago
vulkan: a chain default for engines not measured on an integrated GPU
2ae408e JustVugg committed 1 month ago
gliner_decide: the tool that compares it with the gliner2 package
4304746 JustVugg committed 1 month ago
gliner_decide: GLiNER2.5-Decide as a decision engine (fastino, DeBERTa-v3 + GLiNER2's classification head)
2987361 JustVugg committed 1 month ago
docs: inkling and olmoe in the dense chain, OLMoE measured on a Radeon 780M
3a4e5cb JustVugg committed 1 month ago
olmoe: the dense chain on by default on an integrated GPU with the tier
e07d657 JustVugg committed 1 month ago