Skip to content

Run frontier MoE models on hardware you already own β€” pure C, zero deps, experts streamed from disk. Tiny engine, immense model. 🐦

C

Commits on main

test(kimi): freeze serve wire framing
Mario Gutierrez committed 3 months ago
6a33455
Merge pull request #1088 from JustVugg/perf/k2-union-tile
Vincenzo Fornaro committed 3 months ago
256bbe9
4da41bf
Merge pull request #1086 from JustVugg/fix/k1-followup
Vincenzo Fornaro committed 3 months ago
0ad0ca7
1de2939
Merge pull request #1084 from JustVugg/fix/web-triplet
Vincenzo Fornaro committed 3 months ago
b04d602
refactor(serve): share framing with OLMoE
Mario Gutierrez committed 3 months ago
6104bbb
Merge pull request #1083 from JustVugg/ci/arm-oracle
Vincenzo Fornaro committed 3 months ago
2d2d92d
Merge pull request #1082 from JustVugg/perf/fused3-olmoe
Vincenzo Fornaro committed 3 months ago
438d09a
62b8d63
Merge pull request #1079 from JustVugg/perf/k1-planar
Vincenzo Fornaro committed 3 months ago
fae9553
6132a67
aa05364
73cc7e1
test(serve): freeze OLMoE wire framing
Mario Gutierrez committed 3 months ago
63b8036
Merge pull request #1058 from zh-Processor/main
Vincenzo Fornaro committed 3 months ago
57eeb73
Merge pull request #1077 from JustVugg/perf/qrow-hoist-v4b
Vincenzo Fornaro committed 3 months ago
377a6eb
Merge pull request #1076 from JustVugg/perf/qrow-hoist-v4
Vincenzo Fornaro committed 3 months ago
f70b1ed