Run frontier MoE models on hardware you already own — pure C, zero deps, experts streamed from disk. Tiny engine, immense model. 🐦
C
Commits on main
tests: a reset is the closed connection test_request_read_deadline waits for
a4f57e0 JustVugg committed 1 month ago
Merge pull request #1943 from JustVugg/integ/release-batch-6
1e2b121 Vincenzo Fornaro committed 1 month ago
Merge remote-tracking branch 'origin/dev' into integ/release-batch-6
6e00862 JustVugg committed 1 month ago
Merge pull request #1932 from JustVugg/integ/release-batch-5
871383a Vincenzo Fornaro committed 1 month ago
tests: layers-dev2: the host's part on the device with the KV split on both devices
39cc312 JustVugg committed 1 month ago
Merge branch 'feat/vk-kv-cold-device' into integ/release-batch-6
3289bd6 JustVugg committed 1 month ago
Merge branch 'feat/vk-layers-dev2' into integ/release-batch-6
c9e66e0 JustVugg committed 1 month ago
Merge remote-tracking branch 'origin/dev' into integ/release-batch-5
7f29561 JustVugg committed 1 month ago
tests: dense-only olmoe's automatic cache gate under #1865's budget
4559721 JustVugg committed 1 month ago
Merge pull request #1930 from JustVugg/fix/hardening-2026-10
923a107 Vincenzo Fornaro committed 1 month ago
Merge pull request #1929 from JustVugg/feat/vk-kv-split-chunk
a242a50 Vincenzo Fornaro committed 1 month ago
Merge pull request #1928 from JustVugg/feat/vk-mtp-heads
af463fc Vincenzo Fornaro committed 1 month ago
Merge pull request #1927 from JustVugg/feat/vk-mtp-gpu
00845b1 Vincenzo Fornaro committed 1 month ago
vulkan chain: int8 decode GEMVs with rows a workgroup by the matrix's length
d27edd7 huppiflupp committed 1 month ago
vulkan: a decode step's experts as one grouped GEMV per phase
39cc8c9 huppiflupp committed 1 month ago
tests: layers-dev2-sanitize: Inkling's KV split where kv_san counts it
bcce90f JustVugg committed 1 month ago
tests: build test_st_json_integrity's loader with -D_FILE_OFFSET_BITS=64
d5001b3 JustVugg committed 1 month ago
qwen36: a prompt's routing in parallel; the single expert batch packs in parallel
c4f9113 huppiflupp committed 1 month ago
vulkan: a step's experts as one grouped GEMM, and a big step summed on the device
0d3559b huppiflupp committed 1 month ago