Skip to content

Run frontier MoE models on hardware you already own β€” pure C, zero deps, experts streamed from disk. Tiny engine, immense model. 🐦

C

Commits on main

1deaa25
profile effective CPU expert bandwidth
ZacharyZcR committed 4 months ago
570d738
docs(api): add "Connect a coding CLI or editor" recipe (#373)
KingIcyCreamProjects committed 4 months ago
73e0e5e
profile CPU GPU tier execution costs
ZacharyZcR committed 4 months ago
c3a90ec
cuda: load ragged attention entry point on Windows
ZacharyZcR committed 4 months ago
786f98d
sampling: NaN-skip the mx scan too (review follow-up on #369)
KingIcyCreamProjects committed 4 months ago
e2d39ab
7f70a8d
Merge branch 'p357' into trial357
JustVugg committed 4 months ago
8b36736
Merge branch 'p354' into trialsamp
JustVugg committed 4 months ago
70a5879
1a956b0
Merge pull request #351 from LordMZTE/nix-flake
Vincenzo committed 4 months ago
c1e709e
1223f9c