Skip to content

Run frontier MoE models on hardware you already own — pure C, zero deps, experts streamed from disk. Tiny engine, immense model. 🐦

C

Commits on main

feat(glm53): add Metal routed MoE acceleration
trigger2k20 committed 2 months ago
a214824
f922c09
Merge pull request #1460 from JustVugg/fix/olmoe-prof-disk
Vincenzo Fornaro committed 2 months ago
9bae92a
e762360
Merge pull request #1454 from yuripourre/fix/qwen36-hip-tier
Vincenzo Fornaro committed 2 months ago
fc590c8
fa26477
Merge pull request #1459 from JustVugg/hotfix-setenv
Vincenzo Fornaro committed 2 months ago
a6889c7
fix(build): clean up Clang compiler warnings
trigger2k20 committed 2 months ago
e79aee8
e74d0d7
Merge pull request #1389 from bherald/fix/glm53-ehit-release
Vincenzo Fornaro committed 2 months ago
919cf51
2dac79e
fc73387
fix: enable qwen36 GPU tier when building with HIP=1
Yuri Pourre committed 2 months ago
9ac3137