Skip to content

Run frontier MoE models on hardware you already own — pure C, zero deps, experts streamed from disk. Tiny engine, immense model. 🐦

C

Commits on main

Merge branch 'dev' into main
Vincenzo Fornaro committed 3 months ago
19fba39
Merge pull request #1075 from JustVugg/perf/qrow-hoist-k3
Vincenzo Fornaro committed 3 months ago
5d0986c
Merge pull request #1071 from JustVugg/perf/qrow-hoist
Vincenzo Fornaro committed 3 months ago
c945cd5
8512368
fix(k3): cancel prefill between layers
bherald committed 3 months ago
e5ff623
c3e3edd
docs(k3): clarify mmap RSS accounting
bherald committed 3 months ago
804732e
Merge pull request #1036 from lineape/pr551-rebased
Vincenzo Fornaro committed 3 months ago
d4894f0
Merge pull request #1017 from weber-software/dev
Vincenzo Fornaro committed 3 months ago
f4dcbed
perf: byte-identical CPU/startup optimizations
zh-Processor committed 3 months ago
ca17810
v4: pluggable expert-store backend registry
Konner committed 3 months ago
89365ae
refactor(core): finish registry-owned family dispatch
Mario Gutierrez committed 3 months ago
2ecb5d4