Skip to content

Run frontier MoE models on hardware you already own — pure C, zero deps, experts streamed from disk. Tiny engine, immense model. 🐦

C

Commits on main

e83117e
fp8: fmt=6 (E8/IQ3) branch in qt_scale_bytes()
monotophic committed 4 months ago
9fdc6bb
fp8: correct stale Metal fmt=7 guard comments
monotophic committed 4 months ago
5b797cb
5528589
633013f
292ed4c
2dbfdc1
Merge pull request #457 from monotophic/metal/grouped-gemv
Vincenzo Fornaro committed 3 months ago
df5486c
2ae40d7
Merge pull request #705 from steve-m/vk-kimi-mxfp4
Vincenzo Fornaro committed 3 months ago
c9ab660
Merge pull request #418 from steve-m/vulkan-backend
Vincenzo Fornaro committed 3 months ago
5c267d3