Skip to content

Run frontier MoE models on hardware you already own β€” pure C, zero deps, experts streamed from disk. Tiny engine, immense model. 🐦

C

Commits on main

vk-int3 hardening from first real-container runs
Steve Markgraf committed 4 months ago
4222bf1
vk: open the colibri.c gates for fmt=5 experts
Steve Markgraf committed 4 months ago
50b3b3f
4285198
VK: fuse the q_a+kv_a prologue pair into one submit
Steve Markgraf committed 4 months ago
35fc6e7
22eb4e9
811c427
3e41761
release: bump version to 1.3.0
JustVugg committed 3 months ago
d5f2f9d
1532bc7
Merge pull request #698 from ariannamethod/expert-page-cache
Vincenzo Fornaro committed 3 months ago
72f2851
Merge pull request #676 from steve-m/kimi-k3
Vincenzo Fornaro committed 3 months ago
1c44ef6
feat: integrate Kimi chat with TUI and Web
ZacharyZcR committed 3 months ago
5450c27