Skip to content

Run frontier MoE models on hardware you already own — pure C, zero deps, experts streamed from disk. Tiny engine, immense model. 🐦

C

Commits on main

b09ab5d
serve: wire Host allowlist through CLI
Tasoo Park committed 3 months ago
107b16c
site: favicon = white square, black monochrome mark
Vincenzo Fornaro committed 3 months ago
1b8b62e
Merge pull request #647 from JustVugg/site/new-website
Vincenzo Fornaro committed 3 months ago
93b4c60
new design for website
JustVugg committed 3 months ago
816ad35
b3fafb1
site: new landing page (Anthropic-style)
JustVugg committed 3 months ago
227dd8a
Merge pull request #644 from JustVugg/fix/642-readme-main
Vincenzo Fornaro committed 3 months ago
7db1833
afd6818
Merge pull request #643 from JustVugg/fix/642-readme-hf-link
Vincenzo Fornaro committed 3 months ago
f6ecf5f
2278a08
847b1fd
0e7b2c1
874e8cf
Merge pull request #636 from duringcoffee/docs/arm64-build
Vincenzo Fornaro committed 3 months ago
43e4de3
f5fe934
cfd6dfa
72d2b70
doctor: report shared libraries the engine cannot load
duringcoffee committed 3 months ago
be79f45
test(stops): update the Windows CRT environment
ZacharyZcR committed 3 months ago
1c6fdab
test(stops): clear environment portably on Windows
ZacharyZcR committed 3 months ago
3472d41
fix(chat): retain role stop tokens in private mode
ZacharyZcR committed 3 months ago
6ccb65a
cuda: keep async packed-int4 groups token exact
ZacharyZcR committed 3 months ago
455b071