Run frontier MoE models on hardware you already own — pure C, zero deps, experts streamed from disk. Tiny engine, immense model. 🐦
C
Commits on main
test: add micro-benchmark for DeepSeek V4 indexer batch allocations
458b1d5 Thanniru Sai Teja committed 3 months ago
docs(degrade-zero): per-layer drop reporting and env var docs (PR #906)
37590cc Kritika Garg committed 3 months ago
fix(tools): check temp free space before the eviction write in datapoint.py
a1dfd78 Unknown-Findout committed 3 months ago
Merge branch 'JustVugg:main' into feat/degrade-zero-miss-policy
14b85bd Kritika Garg committed 3 months ago
build(v4/cuda): add CUDA_ARCH=portable-pre-ampere for Pascal and Turing
2146439 8PotatoChip8 committed 3 months ago
perf(dsv4): decode fp8 attention weights with SIMD, not per-element gather
d45e3d2 TheOptik committed 3 months ago
Merge pull request #1175 from JustVugg/fix/tune-metal-plan-label
7f9a1af Vincenzo Fornaro committed 3 months ago
fix(tune): report Metal backend in plan label on Apple Silicon
75e3fb1 JustVugg committed 3 months ago
Merge pull request #1174 from JustVugg/perf/dsv4-o1-cache-miss
5ed33b3 Vincenzo Fornaro committed 3 months ago
Merge pull request #1171 from JustVugg/perf/dsv4-specialize-fp4
9d6affa Vincenzo Fornaro committed 3 months ago
Merge pull request #1170 from jerome-benoit/fix/qwen36-install-dependency
e92634b Vincenzo Fornaro committed 3 months ago
Merge pull request #1167 from JustVugg/fix/uring-mirror
5c822f7 Vincenzo Fornaro committed 3 months ago
Merge pull request #1166 from JustVugg/perf/dsv4-use-fp4-batch-matmul
d2bb447 Vincenzo Fornaro committed 3 months ago
Merge remote-tracking branch 'origin/dev' into perf/dsv4-use-fp4-batch-matmul
a363b73 JustVugg committed 3 months ago
Merge pull request #1164 from JustVugg/perf/dsv4-direct-expert-index
74a5270 Vincenzo Fornaro committed 3 months ago
Merge pull request #1161 from JustVugg/perf/datapoint-persistent-cross-engine
47c7259 Vincenzo Fornaro committed 3 months ago
Merge pull request #1162 from JustVugg/perf/dsv4-concurrent-expert-loads
c27a203 Vincenzo Fornaro committed 3 months ago