Run frontier MoE models on hardware you already own — pure C, zero deps, experts streamed from disk. Tiny engine, immense model. 🐦
C
Commits on main
Merge pull request #830 from dpanelli/swa-kv-ring-buffer
a568db1 Vincenzo Fornaro committed 3 months ago
Merge pull request #1038 from 8PotatoChip8/fix/fma-contract-grouped-int4
1a8e091 Vincenzo Fornaro committed 3 months ago
Merge pull request #1010 from gcaponi/v4-tools-e2e-tests
c64fc66 Vincenzo Fornaro committed 3 months ago
Merge pull request #988 from dcutugno/pr/v4-ssd-mirror
9371b17 Vincenzo Fornaro committed 3 months ago
Merge pull request #1054 from JustVugg/zach/deepseek-v4-cuda-tier
b1d3403 Vincenzo Fornaro committed 3 months ago
Merge pull request #1023 from gouravkargwal/fix/v4-rows16-pack-outside-store-mutex
e36a1c7 Vincenzo Fornaro committed 3 months ago
Merge pull request #931 from Kenneth-Javier/fix/amd-discovery-windows
abbb8de Vincenzo Fornaro committed 3 months ago
Merge pull request #1037 from monotophic/cuda-f8-warp
4f86057 Vincenzo Fornaro committed 3 months ago
Merge pull request #1041 from monotophic/fix/mxfp4-exp255-refmirror
a720c80 Vincenzo Fornaro committed 3 months ago
Merge dev into the DeepSeek V4 CUDA tier (resolve c/Makefile)
ff30465 JustVugg committed 3 months ago
Merge remote-tracking branch 'origin/dev' into pr/v4-ssd-mirror
7a671f0 dcutugno committed 3 months ago
Merge pull request #1052 from JustVugg/hotfix/discord-invite-main
4ef9a99 Vincenzo Fornaro committed 3 months ago
Merge pull request #1051 from JustVugg/fix/discord-invite
255e8aa Vincenzo Fornaro committed 3 months ago
Merge pull request #1025 from Blakeolson21/blake/docker-v4-dsml
1b1a822 Vincenzo Fornaro committed 3 months ago
Merge pull request #1026 from Blakeolson21/blake/atomic-fp8-shards
a49509a Vincenzo Fornaro committed 3 months ago
Merge pull request #1027 from Blakeolson21/blake/atomic-olmoe-shards
c243b4c Vincenzo Fornaro committed 3 months ago
Merge pull request #1028 from terrizoaguimor/fix/k3-mirror-plan
f1bb9c3 Vincenzo Fornaro committed 3 months ago
Merge pull request #1033 from terrizoaguimor/docs/tool-calling-matrix
6d5ceff Vincenzo Fornaro committed 3 months ago
coli: fix stale colibri.c line reference after the dev merge
84beb3e Andrey Aristov committed 3 months ago
fix(windows): set _WIN32_WINNT floor for FILE_ID_INFO under MinGW
dc3f8fd Samiullah Shah committed 3 months ago
fix(build): detect Windows from uname when $(OS) is unset (MSYS2/MinGW)
cc2d039 Samiullah Shah committed 3 months ago
fix(convert): declare numpy in the OLMoE guard, and correct the OLMoE size in the README
fa8b211 Samiullah Shah committed 3 months ago
test(cuda): ISA-robust exp-255 shapes and mixed-scale coverage
d35fe81 monotophic committed 3 months ago
fix(cuda): mxfp4 group scale applied per 32-group when the scale is inf
a53e108 monotophic committed 3 months ago