Skip to content

Run frontier MoE models on hardware you already own — pure C, zero deps, experts streamed from disk. Tiny engine, immense model. 🐦

C

Commits on main

Merge pull request #830 from dpanelli/swa-kv-ring-buffer
Vincenzo Fornaro committed 3 months ago
a568db1
Merge pull request #1010 from gcaponi/v4-tools-e2e-tests
Vincenzo Fornaro committed 3 months ago
c64fc66
Merge pull request #988 from dcutugno/pr/v4-ssd-mirror
Vincenzo Fornaro committed 3 months ago
9371b17
b1d3403
Merge dev (keep $(NVCC_STD) and -ftz=false)
JustVugg committed 3 months ago
db0720c
abbb8de
Merge pull request #1037 from monotophic/cuda-f8-warp
Vincenzo Fornaro committed 3 months ago
4f86057
a720c80
4ef9a99
docs: refresh the expired Discord invite on main
JustVugg committed 3 months ago
afc0a6f
Merge pull request #1051 from JustVugg/fix/discord-invite
Vincenzo Fornaro committed 3 months ago
255e8aa
1b1a822
a49509a
c243b4c
f1bb9c3
6d5ceff
e230ae6
84beb3e
Merge origin/dev into fix/metal-i4-gpu-path
Andrey Aristov committed 3 months ago
7da954a
dc3f8fd
test(cuda): make the mxfp4 compare NaN-aware
monotophic committed 3 months ago
84c6154