Skip to content

Run frontier MoE models on hardware you already own β€” pure C, zero deps, experts streamed from disk. Tiny engine, immense model. 🐦

C

Commits on main

docs: add Traditional Chinese README
BM Cho committed 4 months ago
721bfcb
81a5677
fix: GPU backend failure-path hardening + tests
noobdev-ph committed 4 months ago
288edd7
test_tok_o200k: fgets instead of getline for the windows job
Nicholas Beerbower committed 4 months ago
5ad4d54
st: chunked pread with EINTR retry and honest short-read errors
Nicholas Beerbower committed 4 months ago
6507817
tests: o200k tokenizer coverage, no model download
Nicholas Beerbower committed 4 months ago
9e2d415
364b974
Merge branch 't321' into trial321b
JustVugg committed 4 months ago
d45cfa2
80f886c
98f7c88