Skip to content

Run frontier MoE models on hardware you already own — pure C, zero deps, experts streamed from disk. Tiny engine, immense model. 🐦

C

Commits on main

chore: version 1.6.0
JustVugg committed 3 months ago
52482d7
style: add trailing newline to top-k test
benmaster82 committed 3 months ago
11fe383
fix: reject GLM top-k larger than expert count
benmaster82 committed 3 months ago
639d0c0
c40924e
Merge pull request #941 from JustVugg/v4/expert-union
Vincenzo Fornaro committed 3 months ago
4b9b47d
quant: ARM NEON path for matmul_e8 (fmt=6 E8/IQ3)
Nanetnounou committed 3 months ago
6d44598
fix CNRE cost and capacity accounting
Mario Gutierrez committed 3 months ago
b93e524
Merge pull request #928 from JustVugg/fix/chat-history
Vincenzo Fornaro committed 3 months ago
5fd53a9
Merge pull request #927 from JustVugg/v4/loader-lanes
Vincenzo Fornaro committed 3 months ago
114c5ad
Merge pull request #926 from JustVugg/quant/avx2-matmul-i3
Vincenzo Fornaro committed 3 months ago
cab0108
982b827
e3f4f7f
Merge pull request #904 from Blakeolson21/v4-cli-ctx
Vincenzo Fornaro committed 3 months ago
1e2b293
Merge branch 'dev' into swa-kv-ring-buffer
Davide Panelli committed 3 months ago
8ee7bf2
Merge pull request #915 from mgua/dev
Vincenzo Fornaro committed 3 months ago
72497b0
b2364e5
b347ba4
fix: account real row widths in pin budgets
bherald committed 3 months ago
bc99ebf
fix(cli): preserve pasted multiline prompts
Suliman Abdulrazzaq committed 3 months ago
6ada7bd
3969209