Skip to content

Run frontier MoE models on hardware you already own β€” pure C, zero deps, experts streamed from disk. Tiny engine, immense model. 🐦

C

Commits on main

66b5e57
3f99d2b
Merge pull request #404 from anrasi/fix/indir-meta-resume
Vincenzo Fornaro committed 4 months ago
19bab42
Merge pull request #402 from anrasi/fix/coli-run-think
Vincenzo Fornaro committed 4 months ago
36d389b
Merge branch 'p394' into trialsafe
JustVugg committed 4 months ago
6690c4f
Merge branch 'p366' into trialsafe
JustVugg committed 4 months ago
e5b1e19
Merge branch 'p378' into trialsafe
JustVugg committed 4 months ago
4d780e2
d86a6b9
05bba79
coli: honor THINK=1 in run mode
andres-gb10 committed 4 months ago
799fe41
Merge pull request #384 from ZacharyZcR/perf/auto-numa
Vincenzo Fornaro committed 4 months ago
caa49f7
Merge pull request #372 from ZacharyZcR/feat/paged-ragged-kv
Vincenzo Fornaro committed 4 months ago
3fed654
Merge branch 'p370' into t370
JustVugg committed 4 months ago
4fcbea9
plan NUMA interleave on multi-socket Linux
ZacharyZcR committed 4 months ago
9c17dc6
cuda: keep ragged KV resident across decode steps
ZacharyZcR committed 4 months ago
6d3a616
fb45de2
security: SEC-9 β€” bound untrusted config/oracle JSON slurps
KingIcyCreamProjects committed 4 months ago
df644dc
security: harden model-file parsing, server, and build per audit
KingIcyCreamProjects committed 4 months ago
72dd9ac