Run frontier MoE models on hardware you already own — pure C, zero deps, experts streamed from disk. Tiny engine, immense model. 🐦
C
Commits on main
Merge dev into defaults/metal-cache — resolve TEST_BINS in favour of the wildcard
cec4b18 JustVugg committed 3 months ago
Merge pull request #731 from JustVugg/build/test-bins-autodiscover
2c6ef58 Vincenzo Fornaro committed 3 months ago
build: derive TEST_BINS by wildcard so adding a test stops causing conflicts
b7c1173 JustVugg committed 3 months ago
fix(cli): convert needs its own guard — --model is its destination
d93be65 Mario Gutiérrez committed 3 months ago
fix(cli): no invented model path — say what is missing instead (#724)
b3d7826 Mario Gutiérrez committed 3 months ago
fix: keep E8 experts out of unsupported CUDA group kernels
1584b85 ZacharyZcR committed 3 months ago
metal: fmt=6 (E8/IQ3) expert path — GPU decode + on-GPU FWHT rotation
cdd6ed4 Michael Denyer committed 4 months ago
cuda: reuse decode activations across attention projections
ca05b77 ZacharyZcR committed 3 months ago
stamp: conflicting duplicate claims refuse at ingest (was first-wins)
38c2185 monotophic committed 3 months ago
metal: positive fmt allowlist for the fused decode gates + fmt=7 unreachability sweep
bda0ed0 monotophic committed 3 months ago
registry+tests: fix round 1 -- name parity, MXFP4 row precision, collision-family pinning
575612c monotophic committed 3 months ago
docs: FORMATS.md records the 7 -> 8 renumber, the MXFP4 row, and ID assignment
8bc825a monotophic committed 3 months ago
tests: drain child stderr to EOF in the stamp-test capture helpers
aad0750 monotophic committed 4 months ago
docs: fix stale pre-INVERSION collision narrative (FORMATS.md + repack tool)
0c1ab6b monotophic committed 4 months ago
docs+stamp: non-retroactivity, stamp-map cap, discovery-time abort, .qs scope
1a18eb6 monotophic committed 4 months ago
docs: fix FORMATS.md's colibri.c line/commit references after the #528 restack
92fbb00 monotophic committed 4 months ago
docs: add FORMATS.md, the quantized-format registry (fmt=6/fmt=7 + convention)
24c1ab3 monotophic committed 4 months ago
fp8: qt_resolve_fmt lets a metadata stamp resolve byte collisions
69b99a7 monotophic committed 4 months ago
fp8: self-describing __metadata__ stamp, trust-verify-refuse reader
3a0f01f monotophic committed 4 months ago
fp8: renumber our format fmt 7 -> 8 (#705 claimed 7 for MXFP4)
388a62d monotophic committed 3 months ago