Run frontier MoE models on hardware you already own — pure C, zero deps, experts streamed from disk. Tiny engine, immense model. 🐦
C
Commits on main
Merge pull request #426 from rgbkrk/quod/metal-residency-set-dev
ebd85a7 Vincenzo Fornaro committed 4 months ago
fix(build): test_pipe_block references glm.c, renamed to colibri.c by #391
31526ae JustVugg committed 4 months ago
Merge pull request #338 from noobdev-ph/feat/gpu-backend-hardening
e48513c Vincenzo Fornaro committed 4 months ago
Merge pull request #446 from cdhdt/perf/io-direct-pilot
c98b451 Vincenzo Fornaro committed 4 months ago
Merge pull request #444 from cdhdt/perf/idot-avxvnni-accumulators
04ed004 Vincenzo Fornaro committed 4 months ago
Merge pull request #429 from ZacharyZcR/fix/numa-vma-419
73badea Vincenzo Fornaro committed 4 months ago
Merge pull request #447 from monotophic/metal/rtop8-parallel
aa825d3 Vincenzo Fornaro committed 4 months ago
Merge pull request #342 from ZacharyZcR/feat/expert-group-overlap
0696172 Vincenzo Fornaro committed 4 months ago
Merge pull request #451 from ZacharyZcR/feat/cuda-grouped-g64
e78fcfc Vincenzo Fornaro committed 4 months ago
Merge pull request #432 from ZacharyZcR/feat/cuda-device-router
78a773e Vincenzo Fornaro committed 4 months ago
Merge pull request #433 from ZacharyZcR/fix/decode-grouped-kernels
1aacfcf Vincenzo Fornaro committed 4 months ago
Merge pull request #270 from ebootheee/pr-pipe-batch-sync
e809171 Vincenzo Fornaro committed 4 months ago
site: bring the official website + Pages deploy workflow to main (#424)
c680145 JustVugg committed 4 months ago
Merge pull request #424 from ZacharyZcR/feat/website
d336230 Vincenzo Fornaro committed 4 months ago
Merge pull request #363 from woolcoxm/fix/win32-coli-chat-cuda-autoenable
f8e0612 Vincenzo Fornaro committed 4 months ago
docs: bring the Quick Start guide (incl. Windows prebuilt steps) to main
ec087f6 JustVugg committed 4 months ago
Merge pull request #460 from JustVugg/docs-windows-exe
85e7dff Vincenzo Fornaro committed 4 months ago
docs: explain the prebuilt Windows binary — what the .exe is and how to run it (#450)
7de49fa JustVugg committed 4 months ago
Merge pull request #440 from okuvshynov/test_macpro_2019
505a0f6 Vincenzo Fornaro committed 4 months ago
Merge pull request #332 from woolcoxm/fix/auto-tier-single-core
0337697 Vincenzo Fornaro committed 4 months ago
Merge pull request #360 from woolcoxm/test/efficiency-suite
af23f31 Vincenzo Fornaro committed 4 months ago
Merge pull request #453 from ZacharyZcR/feat/ablation-iq3-scheme
1765ed8 Vincenzo Fornaro committed 4 months ago