Run frontier MoE models on hardware you already own — pure C, zero deps, experts streamed from disk. Tiny engine, immense model. 🐦
C
Commits on main
Merge remote-tracking branch 'origin/dev' into feat/decide-gliner
735aa72 JustVugg committed 1 month ago
Merge pull request #1871 from JustVugg/feat/vk-staged-uploads
0c4a751 Vincenzo Fornaro committed 1 month ago
Merge remote-tracking branch 'origin/dev' into feat/decide-clef
c75d606 JustVugg committed 1 month ago
clef: f16 trunk when the planner's budget holds it, context 16384 by default
65a2574 JustVugg committed 1 month ago
Merge remote-tracking branch 'origin/dev' into feat/decide-gliner
7fbe0be JustVugg committed 1 month ago
Merge remote-tracking branch 'origin/dev' into feat/vk-staged-uploads
ebb8d58 JustVugg committed 1 month ago
tests: qwen's lost-device gates counted from the end of a fault-free run
0c64bdd JustVugg committed 1 month ago
Merge branches 'dev' and 'feat/vk-chain-kimi' of https://github.com/JustVugg/colibri into feat/vk-chain-deepseek
c2fe894 JustVugg committed 1 month ago
qwen36: COLI_DENSE_BITS=16 keeps the dense trunk at the container's f16
cda09af JustVugg committed 1 month ago
olmoe: lend the KV's room to the expert cache until the context uses it
b9180a4 Marcello Costagliola committed 1 month ago
olmoe: take a prompt's MoE expert by expert, the same bits
794d0c0 Marcello Costagliola committed 1 month ago
qwen36 tier: the re-plan orders are total, so ties pick the same victim on every libc
e4a2e3c kreuzzelg committed 1 month ago
tests: the loader ABI tripwire counts the optional coli_cuda_tensor_overwrite
e70b99b kreuzzelg committed 1 month ago
tests(qwen36 tier), docs: test_qwen36_tier_replan; the residents-follow-the-prompt section
b842448 kreuzzelg committed 1 month ago
qwen36: QT_PREFILL_REPLAN=1, re-plan the VRAM residents from the prefill, layer by layer
7555e84 kreuzzelg committed 1 month ago
qwen36 tier: qt_replan, the resident set follows the prompt's own routing
0fc8834 kreuzzelg committed 1 month ago
backend: coli_cuda_tensor_overwrite, new bytes into an uploaded tensor's own buffers
c01b713 kreuzzelg committed 1 month ago
tests(qwen38), ci, docs: test_qwen38_dn_gpu on the tiny FP8 fixture; the layer on the card documented
e1a7898 kreuzzelg committed 1 month ago
qwen38: Q38_DN_GPU=1, decode tokens run the DeltaNet layer on the card end to end
d0824bf kreuzzelg committed 1 month ago
qwen36 tier: qt_dn_gpu_init_dense, the DeltaNet layer from three dense handles
51bc861 kreuzzelg committed 1 month ago
backend: the gated-delta step takes a gate mode and a split in_proj
4bbc228 kreuzzelg committed 1 month ago
Merge pull request #1855 from namespaceMarcello/fix/dsv41-engram-bounds
0813cf8 Vincenzo Fornaro committed 1 month ago
qwen36: g_clef only where the serve loop that reads it is compiled
1224019 JustVugg committed 1 month ago
Merge remote-tracking branch 'origin/dev' into feat/vk-chain-kimi
999014a JustVugg committed 1 month ago
Merge pull request #1854 from namespaceMarcello/fix/glm53-mat-shape
ff12462 Vincenzo Fornaro committed 1 month ago