Run frontier MoE models on hardware you already own — pure C, zero deps, experts streamed from disk. Tiny engine, immense model. 🐦
C
Commits on main
tests: qualify host isnan as std::isnan (HIP cmath host overload wart)
84c85e5 monotophic committed 3 months ago
tests: drop direct cuda_runtime.h includes (hipcc has no such header)
17bfc3e monotophic committed 3 months ago
build: close the compute_121 gate when nvcc version is unparsable
7aaf9d2 monotophic committed 3 months ago
tests: dense accumulation-convention bite through coli_cuda_matmul
aabe371 monotophic committed 3 months ago
docs: COLI_CUDA_F8_WARP entry matches per-vendor default and mode semantics
8ab17dc monotophic committed 3 months ago
tools: commit run_f8_bench.sh (BENCH_PEAK_GBPS=273 default for GB10)
669b488 monotophic committed 3 months ago
build: gate compute_121 on nvcc >= 12.9; run fp8_warp_test before mxfp4
7783377 monotophic committed 3 months ago
bench: roofline from BENCH_PEAK_GBPS only; report raw memory attributes
1419dff monotophic committed 3 months ago
tests: grouped accumulation-convention bite and vec/byte load-path parity
1b6de08 monotophic committed 3 months ago
cuda: dense fmt=8 honors COLI_CUDA_F8_WARP; unify vec/byte product sequence
cb73d1a monotophic committed 3 months ago
bench: query roofline via device attributes (cudaDeviceProp members gone in CUDA 13)
9bf565d monotophic committed 3 months ago
bench: fmt=8 old-vs-warp kernel bandwidth harness (JSON, fp8-bench target)
a6fb69a monotophic committed 3 months ago
tests: fmt=8 warp-kernel oracle (sweep, census/tail shapes, S-invariance)
9aa32f2 monotophic committed 3 months ago
cuda: warp-per-row fmt=8 kernels with reference-mirroring accumulation
268c74f monotophic committed 3 months ago
build: add sm_121 gencode to the portable fatbin and pin -ftz=false
600a3e0 monotophic committed 3 months ago
Merge pull request #969 from terrizoaguimor/fix/v4-usage-route-trace
e27c37e Vincenzo Fornaro committed 3 months ago
Merge pull request #958 from Blakeolson21/fix/openmp-team-launch-paths
0f335e5 Vincenzo Fornaro committed 3 months ago
Merge pull request #947 from gouravkargwal/ci/metal-test
7065f20 Vincenzo Fornaro committed 3 months ago
fix(v4): pack hot pinned experts outside state->mutex (issue #900)
e53018c Gourav Kargwal committed 3 months ago
Merge pull request #1021 from JustVugg/fix/release-package-v4dsml
5ca9161 Vincenzo Fornaro committed 3 months ago