Skip to content

Run frontier MoE models on hardware you already own β€” pure C, zero deps, experts streamed from disk. Tiny engine, immense model. 🐦

C

Commits on main

34513cc
58ac189
mgua: added info about cpu optimizations
marco guardigli committed 3 months ago
50dae22
e47bf00
1b10ddc
test(k3): close mapped fixture handles
bherald committed 3 months ago
7eaa95f
06dd054
279379d
feat(k3): map prepared weights read-only
bherald committed 3 months ago
6e5f36a
fc8020e
1654f39
docs: add Apple M3 16 GB OLMoE datapoint row
Gourav Kargwal committed 3 months ago
4039458
tools: add one-command datapoint runner
Gourav Kargwal committed 3 months ago
971b3f6
Merge pull request #946 from JustVugg/v4/macos
Vincenzo Fornaro committed 3 months ago
33302b8
Merge pull request #944 from benmaster82/fix/glm-topk-bounds
Vincenzo Fornaro committed 3 months ago
54c970f
Merge branch 'dev' into ci/metal-test
Vincenzo Fornaro committed 3 months ago
c281dba
6c91350
ci: run Metal backend tests on macOS
Gourav Kargwal committed 3 months ago
0574ece