Skip to content

Run frontier MoE models on hardware you already own — pure C, zero deps, experts streamed from disk. Tiny engine, immense model. 🐦

C

Commits on main

fix(build): track SSE4.1 kernel header dependencies
codex 20260920-012741-906614622 committed 2 months ago
a3ec030
fix(sse41): preserve grouped-int4 scalar order
codex 20260830-005353-2548412838 committed 2 months ago
e09b3db
perf(sse41): vectorize grouped-int4 GEMV
codex 20260829-144356-267014324 committed 2 months ago
4d35744
CHANGELOG 1.12.1: #1402
JustVugg committed 1 month ago
7dbe7e3
b94accc
2cc1040
5f1cb69
Merge branch 'dev' into feat/windows-xdna-shared-expert-lane
Kenneth-Javier Ortigoza committed 1 month ago
2a3b17c
feat(api): accept and ignore a per-request seed
monotophic committed 1 month ago
7d79ad1
0ad3eef
6826c00
9e152d4
11106c9
9e2555a
Merge pull request #1559 from kreuzzelg/qwen36-down-bits
Vincenzo Fornaro committed 1 month ago
2051c18
9ddd00a