Skip to content

Run frontier MoE models on hardware you already own — pure C, zero deps, experts streamed from disk. Tiny engine, immense model. 🐦

C

Commits on main

d801c9d
fix(mirror): verify complete mirrors without receipt
trigger2k20 committed 2 months ago
b3f69a4
Merge pull request #1445 from JustVugg/fix/olmoe-ram-budget
Vincenzo Fornaro committed 2 months ago
23cd9f5
f417ee7
66ee883
264d80d
45e7b7f
docs: reword malloc_trim comment
iiEliJas committed 2 months ago
c848123
50f9ee9
a630fd5
Merge pull request #1435 from iiEliJas/fix/musl-malloc-trim
Vincenzo Fornaro committed 2 months ago
888e1ed
Merge pull request #1432 from texasich/fix/1429
Vincenzo Fornaro committed 2 months ago
1168176
Merge pull request #1433 from texasich/fix/bench-recipe
Vincenzo Fornaro committed 2 months ago
0288878