Run frontier MoE models on hardware you already own — pure C, zero deps, experts streamed from disk. Tiny engine, immense model. 🐦
C
Commits on main
v4: support arm64 macOS — one mach branch, the rest was already portable
57f0abd JustVugg committed 3 months ago
Merge pull request #942 from dcutugno/fix/cli-attached-reply-tail
c40924e Vincenzo Fornaro committed 3 months ago
Merge pull request #930 from terrizoaguimor/fix/cnre-simulator-accounting
2c8ce27 Vincenzo Fornaro committed 3 months ago
Merge pull request #941 from JustVugg/v4/expert-union
4b9b47d Vincenzo Fornaro committed 3 months ago
v4: expert-major prefill — read each distinct expert once per chunk
b00e353 JustVugg committed 3 months ago
fix(cli): close the markdown stream before stopping the spinner
e6f014d dcutugno committed 3 months ago
Merge pull request #928 from JustVugg/fix/chat-history
5fd53a9 Vincenzo Fornaro committed 3 months ago
Merge pull request #927 from JustVugg/v4/loader-lanes
114c5ad Vincenzo Fornaro committed 3 months ago
Merge pull request #926 from JustVugg/quant/avx2-matmul-i3
cab0108 Vincenzo Fornaro committed 3 months ago
fix(cli): activate readline so UP/DOWN recall previous prompts
360da8c JustVugg committed 3 months ago
v4: enable the expert-loader pool and make its depth runtime-tunable
48db957 JustVugg committed 3 months ago
quant: AVX2 kernel for int3-g64 matmul (was scalar on x86)
982b827 Steve Markgraf committed 4 months ago
Merge pull request #897 from Blakeolson21/v4-omp-loader-reservation
e3f4f7f Vincenzo Fornaro committed 3 months ago
Merge pull request #903 from terrizoaguimor/pr/placement-accounting-clean
afc771a Vincenzo Fornaro committed 3 months ago
Merge pull request #909 from SulimanAbdulrazzaq/fix/907-multiline-prompts
ed6b475 Vincenzo Fornaro committed 3 months ago
Merge pull request #904 from Blakeolson21/v4-cli-ctx
1e2b293 Vincenzo Fornaro committed 3 months ago
Merge pull request #902 from terrizoaguimor/pr/cnre-simulator-clean
b2364e5 Vincenzo Fornaro committed 3 months ago
Merge pull request #914 from bherald/fix/mixed-width-pin-budget-885
b347ba4 Vincenzo Fornaro committed 3 months ago
mgua: added a revised section for cuda enabled builds on laptop, minimal installs, mingw64 gcc and make and nvcc. no edits on *precious* previous text.
fbdef20 marco guardigli committed 3 months ago
feat(degrade-zero): startup announcement + bit-identical test (issue #865)
3969209 Workshop Participant committed 3 months ago
fix(degrade-zero): per-position tau gate, no renorm (issue #865)
ecd369c Kritika Garg committed 3 months ago