Skip to content

Run frontier MoE models on hardware you already own β€” pure C, zero deps, experts streamed from disk. Tiny engine, immense model. 🐦

C

Commits on main

Merge pull request #456 from monotophic/convert/resume-guard
Vincenzo Fornaro committed 4 months ago
bb2bae8
Merge pull request #437 from 4ny3l/fix-tool-calling-401
Vincenzo Fornaro committed 4 months ago
3ddbc65
3455eee
win32: auto-enable the GPU in bare coli chat
woolcoxm committed 4 months ago
0b05f6a
numa: skip binding the GPU-prefix staging slabs
ZacharyZcR committed 4 months ago
57e67d6
Merge pull request #449 from cdhdt/fix/rss-guard-uaf
Vincenzo Fornaro committed 4 months ago
e9b3614
4b70482
Merge pull request #393 from ZacharyZcR/feat/auto-tune
Vincenzo Fornaro committed 4 months ago
17fbdfa
Merge pull request #438 from monotophic/e7/disk-class-instr
Vincenzo Fornaro committed 4 months ago
a7ef058
fix: old x86 Mac scalar -> vnni
Oleksandr Kuvshynov committed 4 months ago
5c84b25
fbabaa4