Skip to content

Run frontier MoE models on hardware you already own — pure C, zero deps, experts streamed from disk. Tiny engine, immense model. 🐦

C

Commits on main

docs: keep README unchanged
EricSpencer00 committed 2 months ago
77175bc
test: guard router benchmark equivalence
EricSpencer00 committed 2 months ago
855baac
test: record sparse routing benchmark
EricSpencer00 committed 2 months ago
b867260
perf: avoid duplicate scans in sparse router
EricSpencer00 committed 2 months ago
544f00c
1efb7c8
Merge pull request #1494 from JustVugg/feat/v4-prof-phases
Vincenzo Fornaro committed 2 months ago
9c7644c
a459928
Merge pull request #1486 from JustVugg/fix/no-config-no-glm
Vincenzo Fornaro committed 2 months ago
3874d71
422fd38
6038654
Merge pull request #1482 from JustVugg/feat/chat-stats
Vincenzo Fornaro committed 2 months ago
e155c73
Merge pull request #1481 from JustVugg/fix/glm53-stop-ids
Vincenzo Fornaro committed 2 months ago
035699f
Merge pull request #1480 from JustVugg/fix/st-overlay-index
Vincenzo Fornaro committed 2 months ago
b22d83b
ca93285