Run frontier MoE models on hardware you already own — pure C, zero deps, experts streamed from disk. Tiny engine, immense model. 🐦
C
Commits on main
vulkan: a chain default for engines not measured on an integrated GPU
3306591 JustVugg committed 1 month ago
Merge remote-tracking branch 'origin/dev' into feat/vk-chain-mimo
28259bc JustVugg committed 1 month ago
tests: inkling's and olmoe's dense chain on Lavapipe, and under ASan and UBSan
84b8934 JustVugg committed 1 month ago
tests: the GLM engines' dense chain on Lavapipe, and under ASan and UBSan
69faa75 JustVugg committed 1 month ago
Merge pull request #1844 from JustVugg/feat/vk-dense-chain-qwen
bf19ccc Vincenzo Fornaro committed 1 month ago
vulkan: KDA, hyper-connections and the k-pooled indexer on the chain
6052a4c JustVugg committed 1 month ago
mimo: the tier's budget leaves the dense chain's KV caches room
61f669c JustVugg committed 1 month ago
tests: MiMo's dense chain on Lavapipe, and under ASan and UBSan
da40e53 JustVugg committed 1 month ago
Merge remote-tracking branch 'origin/dev' into feat/vk-chain-ink-olmoe
020c433 JustVugg committed 1 month ago
vulkan: Inkling's short convolution and attention as chain ops
0b46757 JustVugg committed 1 month ago
olmoe: the slot the forward pass reads is never the prefetcher's victim
0e0f569 JustVugg committed 1 month ago
Merge remote-tracking branch 'origin/dev' into feat/vk-chain-mimo
b900d35 JustVugg committed 1 month ago
Merge remote-tracking branch 'origin/dev' into feat/vk-chain-mla
17246ce JustVugg committed 1 month ago
Merge remote-tracking branch 'origin/dev' into feat/vk-dense-chain-qwen
217fc32 JustVugg committed 1 month ago
vulkan: read the GEMM's activations through one view of binding 0
af32666 Courtney Andrew Richardson committed 1 month ago
vulkan: build the expert batch's pipelines from their own shader modules
b12523e Courtney Andrew Richardson committed 1 month ago
Merge pull request #1845 from JustVugg/fix/asan-avx512-runners
77647ee Vincenzo Fornaro committed 1 month ago
tests: sanitizer runs and inkling's tier gate on AVX-512 runners
df9900d JustVugg committed 1 month ago
vulkan: the chain's attention takes a sliding window, a ring and a sink
e33da31 JustVugg committed 1 month ago
Merge remote-tracking branch 'origin/dev' into feat/vk-dense-chain-qwen
9a3c094 JustVugg committed 1 month ago
Merge pull request #1842 from JustVugg/feat/one-click-setup
3c7f509 Vincenzo Fornaro committed 1 month ago
Merge remote-tracking branch 'origin/dev' into feat/vk-dense-chain-qwen
4676264 JustVugg committed 1 month ago