Run frontier MoE models on hardware you already own — pure C, zero deps, experts streamed from disk. Tiny engine, immense model. 🐦
C
Commits on main
fix(tests): build mxfp4_ref.c without OpenMP so cuda-test links on hosts without libgomp (#971)
6dd1ebc Unknown-Findout committed 2 months ago
Merge pull request #1179 from iam-saiteja/perf/persistent-indexer-scratch
893215e Vincenzo Fornaro committed 2 months ago
Merge pull request #1223 from JustVugg/feat/segment-conformance-all-engines
b42be28 Vincenzo Fornaro committed 2 months ago
Merge pull request #1221 from JustVugg/feat/lumabri-runtime-api
1a13cd3 Vincenzo Fornaro committed 2 months ago
build(v4): simplify Makefile build rule for bench_indexer_allocations
ac4827c Thanniru Sai Teja committed 2 months ago
build(v4): add build-on-demand rule for bench_indexer_allocations in Makefile
acbe591 Thanniru Sai Teja committed 2 months ago
perf(v4): limit indexer scratch arena growth to needed + needed/4 with 64KB floor to save RAM
79e5b88 Thanniru Sai Teja committed 2 months ago
Merge pull request #1222 from JustVugg/fix/dsv4-cuda-detect-hardening
566b27e Vincenzo Fornaro committed 2 months ago
style(v4): declare indexer in_use flag as char to match __atomic_test_and_set primitive
910e1c8 Thanniru Sai Teja committed 2 months ago
Merge pull request #1220 from JustVugg/fix/dsv4-cuda-linux-detect
d0f4e76 Vincenzo Fornaro committed 2 months ago
fix(coli): detect the Linux DeepSeek V4 CUDA build, not just the Windows DLL
9ccead7 JustVugg committed 2 months ago
Merge pull request #1216 from JustVugg/docs/readme-v18
86ed397 Vincenzo Fornaro committed 2 months ago
Merge pull request #1215 from JustVugg/perf/cache-index-all-engines
51d8aa0 Vincenzo Fornaro committed 2 months ago
Merge pull request #1213 from JustVugg/perf/dsv4-bank-double
ee9bc1f Vincenzo Fornaro committed 2 months ago
perf(dsv4): double-buffered expert bank prefetch for GPU prefill (COLI_CUDA_MOE_DOUBLE=1)
9876c4d JustVugg committed 2 months ago
fix(v4): advance scratch_ptr by sz_xs in GPU tier block
6de5600 Thanniru Sai Teja committed 2 months ago
fix(v4): make indexer in_use reentrancy guard atomic via __atomic_test_and_set
8b93d9b Thanniru Sai Teja committed 2 months ago
perf(v4): replace realloc with malloc+free on growth, enforce in_use guard, and wrap GPU scratch sizes in COLI_V4_GPU_TIER
2776b51 Thanniru Sai Teja committed 2 months ago
Merge pull request #1211 from JustVugg/perf/dsv4-open-once
c6b951a Vincenzo Fornaro committed 2 months ago
Merge pull request #1105 from monotophic/feat/fp8-mint-full-family
b861dac Vincenzo Fornaro committed 2 months ago