Skip to content

Run frontier MoE models on hardware you already own — pure C, zero deps, experts streamed from disk. Tiny engine, immense model. 🐦

C

Commits on main

ef51b80
clean: vk_tier.o goes with its .d
JustVugg committed 1 month ago
33fe39f
63ac5d6
7b347c8
vk_tier: promotions per token, not per forward
JustVugg committed 1 month ago
5e7215e
8a93fde
qwen36: routed experts on the Vulkan tier
JustVugg committed 1 month ago
2553530
qwen38: routed experts on the Vulkan tier
JustVugg committed 1 month ago
a710740
53310db
8001d05