Skip to content

Run frontier MoE models on hardware you already own — pure C, zero deps, experts streamed from disk. Tiny engine, immense model. 🐦

C

Commits on main

Merge branch 'dev' into feat/windows-xdna-shared-expert-lane
Kenneth-Javier Ortigoza committed 2 months ago
c2357fa
olmoe, qwen36: PROF at microsecond resolution
JustVugg committed 2 months ago
e4f3b99
Merge pull request #1424 from kreuzzelg/qwen38-cuda-tier
Vincenzo Fornaro committed 2 months ago
2546d6a
Merge pull request #1503 from JustVugg/fix/run-snap-non-glm
Vincenzo Fornaro committed 2 months ago
333e760
9b4eb1a
a572518
ef011dc
82ee2ce
6cea190
4bc6c56
Merge pull request #1505 from JustVugg/fix/hip-s4-wmma-gate
Vincenzo Fornaro committed 2 months ago
068e729
35eabcc
1812ba6
18cbd57
ca772f5
7ed6084