Skip to content

Run frontier MoE models on hardware you already own β€” pure C, zero deps, experts streamed from disk. Tiny engine, immense model. 🐦

C

Commits on main

c666d43
Merge pull request #542 from opxyc/feat/olmoe-chat-mode
Vincenzo Fornaro committed 3 months ago
74112da
Merge pull request #703 from JustVugg/dev
Vincenzo Fornaro committed 3 months ago
01abef3
Merge pull request #704 from JustVugg/feat/inkling-topp
Vincenzo Fornaro committed 3 months ago
ff16fed
docs: qualify the ROCm-comparison claim in README
Steve Markgraf committed 4 months ago
0b73b39
3cba6ce
vulkan: issue dev2 expert group on a worker thread
Steve Markgraf committed 4 months ago
ec3cdc7
vulkan: spin-then-block fence waits on the sync paths
Steve Markgraf committed 4 months ago
0e90776
75175ef
2737ee6
2d13ab4
vulkan: PROF anatomy of the expert block (VK-BLOCK line)
Steve Markgraf committed 4 months ago
22b26aa
da8149d