Run frontier MoE models on hardware you already own — pure C, zero deps, experts streamed from disk. Tiny engine, immense model. 🐦
C
Commits on main
docs(ja): README.ja.md carries every section of the English README
84147d0 JustVugg committed 1 month ago
docs(it): README.it.md carries every section of the English README
00d83cc JustVugg committed 1 month ago
site: cards for every model on dev, GLM-5.3 on the right card, Vulkan
0fb1303 JustVugg committed 1 month ago
docs: bring the translated READMEs' roster and tables in line with English
10c0018 JustVugg committed 1 month ago
docs: README roster, requirements and family tables for every engine on dev
8cab2d0 JustVugg committed 1 month ago
qwen38 MTP: gated in CI; the harness leaves the test_*.py glob
4ac9ed7 JustVugg committed 1 month ago
qwen38 MTP: wiring b by default, measured on the release; wiring c removed
af2a522 JustVugg committed 1 month ago
qwen38 MTP: tiny fixtures with a head, a torch reference, the lossless gate
439c838 JustVugg committed 1 month ago
qwen38: speculative decoding with the checkpoint's MTP head (Q38_MTP=1)
edb9bbe JustVugg committed 1 month ago
Merge pull request #1831 from JustVugg/feat/qwen38-int4-experts
d3b9251 Vincenzo Fornaro committed 1 month ago
Merge remote-tracking branch 'origin/dev' into feat/qwen38-int4-experts
66a1a23 JustVugg committed 1 month ago
resource_plan: price Qwen3.8's expert cache with the int4-g64 sidecar
22bb80b JustVugg committed 1 month ago
qwen38: routed experts as int4-g64 from an experts-int4g64/ sidecar
aa3db0a JustVugg committed 1 month ago
Merge pull request #1830 from JustVugg/feat/vulkan-all-engines
c6d5530 Vincenzo Fornaro committed 1 month ago
docs/vulkan: what every engine puts on the device, and what it costs
b1d83e8 JustVugg committed 1 month ago
ci: the Vulkan formats and every engine's Vulkan path on Lavapipe
6fdc4ea JustVugg committed 1 month ago
deepseek_v4: resident fp8 and bf16 matrices on the Vulkan device
9f4eb91 JustVugg committed 1 month ago
deepseek_v41: the resident trunk on the Vulkan device (fp8 fmt 12, bf16 fmt 11)
7a98c98 JustVugg committed 1 month ago
tests: vulkan_engines.sh, every engine's Vulkan path against its CPU run
ba76bf1 JustVugg committed 1 month ago
vulkan: COLI_VK_TEST_MATMUL_ONLY stops the harness after the format cases
eb924ea JustVugg committed 1 month ago
mimo, qwenimage: the float dense matrices on Vulkan too (fmt 10, 11, 12)
be553ee JustVugg committed 1 month ago