Skip to content

Run frontier MoE models on hardware you already own — pure C, zero deps, experts streamed from disk. Tiny engine, immense model. 🐦

C

Commits on main

Merge pull request #543 from opxyc/feat/olmoe-safe-converter
Vincenzo Fornaro committed 3 months ago
cd6a342
7b03ce0
Merge pull request #600 from lBroth/fix/596-metal-sdk-floor
Vincenzo Fornaro committed 3 months ago
43c13ac
Merge pull request #541 from opxyc/feat/olmoe-avx2-int8-dot
Vincenzo Fornaro committed 3 months ago
0d1f658
aa6a279
c5aac27
32aa34f
cf56052
Removing local folder from ignore file.
Grecco committed 4 months ago
0d5df23
Merge origin/dev into feature/amd-rx-7900-xtx
Grecco committed 4 months ago
27d8da8
00561ef
26629e7
f381d4c
926dde9
11cd1c6
de62a18
e24995a
e04bbdc
6352a4e
5dc736a