Skip to content

Run frontier MoE models on hardware you already own β€” pure C, zero deps, experts streamed from disk. Tiny engine, immense model. 🐦

C

Commits on main

Merge #504: fix broken anchor links in the Docker READMEs
Vincenzo Fornaro committed 4 months ago
645d6fb
Fixed (I hope) broken anchor links
Davide Quack committed 4 months ago
c5b9d5a
81ab0f3
d1696af
Merge #473: int4 IDOT at S=1 on AVX-512 VNNI (g_i4s=1)
Vincenzo Fornaro committed 4 months ago
52fee21
b50524d