Skip to content

Run frontier MoE models on hardware you already own — pure C, zero deps, experts streamed from disk. Tiny engine, immense model. 🐦

C

Merge pull request #362 from EgonRuiter/prefetcher-v3

JustVugg22509fccde65
diff --cc .gitignore
index 981e7400,c06902f7..a65fd3df
--- a/.gitignore
+++ b/.gitignore
@@@ -67,4 -67,7 +67,8 @@@ c/bench
c/tests/test_decode_batch
c/tests/test_i4_acc512
c/tests/test_idot
+c/tests/test_uring
+ olmoe_merged/
+ olmoe_i4/
+ c/olmoe_merged/
+ c/olmoe_i4/