Run frontier MoE models on hardware you already own — pure C, zero deps, experts streamed from disk. Tiny engine, immense model. 🐦
C
Commits on main
Merge pull request #833 from JustVugg/fix/serve-broken-pipe
ecc94ee Vincenzo Fornaro committed 3 months ago
Merge pull request #832 from JustVugg/feat/banner-model
cc65879 Vincenzo Fornaro committed 3 months ago
test(loader): the ABI tripwire counted 46 symbols; dev has 47 + 3
f2c3c55 JustVugg committed 3 months ago
Merge pull request #831 from JustVugg/feat/v4-kv-prefix
ecd4cc8 Vincenzo Fornaro committed 3 months ago
Merge pull request #788 from Kenneth-Javier/feature/windows-hip-native
f6dc66e Vincenzo Fornaro committed 3 months ago
Merge pull request #799 from ZacharyZcR/docs/environment-coverage
9d096dc Vincenzo Fornaro committed 3 months ago
Merge pull request #808 from ZacharyZcR/ci/efficiency-gate
3ad9672 Vincenzo Fornaro committed 3 months ago
Merge pull request #803 from ZacharyZcR/feat/docker-ci
95176c8 Vincenzo Fornaro committed 3 months ago
Merge pull request #794 from ZacharyZcR/docs/glm52-inference-research-closeout
280fe8a Vincenzo Fornaro committed 3 months ago
Merge pull request #795 from ZacharyZcR/feat/paged-ragged-kv-research-runtime
2f3dc01 Vincenzo Fornaro committed 3 months ago
Merge pull request #817 from kreuzzelg/cuda-fp8-e4m3
dc0c979 Vincenzo Fornaro committed 3 months ago
Merge pull request #828 from monotophic/docs/formats-rans-registration-r1
19462f4 Vincenzo Fornaro committed 3 months ago
Merge pull request #567 from winklemad/fix/stateful-ngen-kv-tail
18d7c3a Vincenzo Fornaro committed 3 months ago
Merge pull request #764 from ThefloorMiner/experiment/glm52-4xa6000
9788085 Vincenzo Fornaro committed 3 months ago
Merge pull request #796 from ZacharyZcR/docs/research-acknowledgements-current
c80960c Vincenzo Fornaro committed 3 months ago
deepseek_v4: reuse the KV prefix instead of re-prefilling every turn
c08dd23 JustVugg committed 3 months ago
Merge branch 'dev' into feature/windows-hip-native
aa60f7b Kenneth-Javier Ortigoza committed 3 months ago
docs(fmt2): M1 Ultra fmt=2 benchmark context — issue/PR summaries, plans, scripts
1743054 boblaublaw committed 3 months ago
fix(metal): run int4-g64 (fmt=4) models on the GPU — MoE experts + fused attention
a9f31f1 Andrey Aristov committed 3 months ago
fix(coli): truthful splash + visible engine status lines in chat
6576069 Andrey Aristov committed 3 months ago
Merge pull request #802 from whale-agent-lab/codex/st-shape-rank-sizes
9f30f38 Vincenzo Fornaro committed 3 months ago
Merge pull request #806 from ZacharyZcR/perf/omp-grain-guard
83b06ac Vincenzo Fornaro committed 3 months ago
Merge pull request #818 from ZacharyZcR/test/kimi-tokenizer-gate
1e12047 Vincenzo Fornaro committed 3 months ago
Merge pull request #815 from bherald/perf/autopin-preserve-lru
a4d7b90 Vincenzo Fornaro committed 3 months ago
Merge pull request #805 from ThefloorMiner/fix/omp-threads-all-platforms
2e3c475 Vincenzo Fornaro committed 3 months ago