Skip to content

Run frontier MoE models on hardware you already own — pure C, zero deps, experts streamed from disk. Tiny engine, immense model. 🐦

C

Commits on main

b5968eb
Detect Metal GPUs in macOS resource plans
Karel Moravec committed 2 months ago
7dfdb05
Merge pull request #1553 from JustVugg/feat/kv-prefix-reuse
Vincenzo Fornaro committed 2 months ago
1330bfd
de83684
tests: guard -x none on the HIP build
huppiflupp committed 2 months ago
654ff83
7b46843
Merge dev 87c54a93 into evidence/python-tooling
monotophic committed 2 months ago
5e9b113
9dd5ec7
b6d7297
87c54a9
Merge pull request #1521 from rcklomp/perf/hc-parallel-mix
Vincenzo Fornaro committed 2 months ago
0264c5a
Merge pull request #1524 from rcklomp/perf/kda-parallel
Vincenzo Fornaro committed 2 months ago
48df0fa
Merge pull request #1517 from LiRunGuo/fix/omp-team-sizing
Vincenzo Fornaro committed 2 months ago
2c917b2
Merge pull request #1522 from LiRunGuo/feat/dsv41-expert-io
Vincenzo Fornaro committed 2 months ago
6c68af9
Merge branch 'dev' into fix/hip-test-cuda-runtime-include
Vincenzo Fornaro committed 2 months ago
955974b
Merge pull request #1513 from huppiflupp/vk-integrated
Vincenzo Fornaro committed 2 months ago
12a1104
4cdc736