Run frontier MoE models on hardware you already own β pure C, zero deps, experts streamed from disk. Tiny engine, immense model. π¦
C
Commits on main
Merge pull request #1112 from JustVugg/release/v1.7.0
940ea50 Vincenzo Fornaro committed 3 months ago
docs: CHANGELOG β LRU victim selection vs lowered ecap (#1121)
f7d4754 JustVugg committed 3 months ago
Merge pull request #1121 from ZacharyZcR/fix/1034-rss-guard-cap
909f2b4 Vincenzo Fornaro committed 3 months ago
docs: CHANGELOG β the CUDA fix batch, USAGE_SAVE, warning cleanup
4a1f763 JustVugg committed 3 months ago
Merge pull request #1115 from JustVugg/fix/cuda-weights-owned-rebased
e0e3cc4 Vincenzo Fornaro committed 3 months ago
Merge pull request #1123 from ZacharyZcR/fix/1032-warnings
0419d23 Vincenzo Fornaro committed 3 months ago
Merge pull request #1122 from ZacharyZcR/fix/1039-usage-save
aabf942 Vincenzo Fornaro committed 3 months ago
test(cuda): alias cudaMemcpyKind/cudaErrorInvalidValue per vendor for the HIP build
97bf97f monotophic committed 3 months ago
test(cuda): keep the memcpy injection hook inside backend_gpu_compat.h's mapped surface
01b70a1 monotophic committed 3 months ago
fix(cuda): set weights_owned before the H2D copy so failed uploads free their buffer
7612433 monotophic committed 3 months ago
chore: apply the v1.6.2 warning-cleanup patches from #1032
863bf1e ZacharyZcR committed 3 months ago
planner: add DeepSeek V4 geometry adapter (issue #1066) -- completes all 4 families
655dde7 SebaWag committed 3 months ago
planner: add Inkling hybrid GQA/sconv geometry adapter (issue #1066)
d7a4890 SebaWag committed 3 months ago
Merge pull request #829 from aaristov/fix/metal-i4-gpu-path
692e61e Vincenzo Fornaro committed 3 months ago
fix(cache): make LRU victim selection respect a lowered ecap
b00688b ZacharyZcR committed 3 months ago
Merge pull request #1114 from JustVugg/fix/cuda-fmt8-rebased
9b6e949 Vincenzo Fornaro committed 3 months ago
docs: CHANGELOG β Metal Kimi K3, the correctness batch, planner and codec work
d0ef133 JustVugg committed 3 months ago
test(cuda): alias cudaMemset/cudaErrorUnknown per vendor for the HIP build
766a803 monotophic committed 3 months ago
test(cuda): derive fmt trap expectations from the host predicate
2ca990f monotophic committed 3 months ago
docs: deliver the fp8 full-family and kv_b_proj decode-caveat documentation
6b7a13d monotophic committed 3 months ago
fix(tools): content-validate fp8 repack resume and refuse malformed inputs
ae2f1dc monotophic committed 3 months ago
fix(cuda): refuse undecodable weight formats in weight_at instead of falling through to int2
2a268b6 monotophic committed 3 months ago