Run frontier MoE models on hardware you already own — pure C, zero deps, experts streamed from disk. Tiny engine, immense model. 🐦
C
Commits on main
Merge pull request #1549 from basil-k-aji-dev/fix/st-shard-table-race
3326b5f Vincenzo Fornaro committed 2 months ago
Merge pull request #1557 from Ti-03/fix/qwen36-truncated-utf8
033eb61 Vincenzo Fornaro committed 2 months ago
fix(tools): open the partial read-write before fsync on Windows
3ea116f Léon Avic Simmons committed 2 months ago
fix(tools): accept a qpack manifest that does not declare layout.json
09e0f68 Léon Avic Simmons committed 2 months ago
feat(tools): hash-verified qpack installers for Hugging Face and static mirrors
e547494 Léon Avic Simmons committed 2 months ago
fix RoPE docs, preflight expert check, run numerical tests in CI with a new job
bee8af0 matteo committed 2 months ago
coli: apply the plan's VRAM tier on the sibling path, not just report it (#1581)
28959fa JustVugg committed 2 months ago
coli: say when --auto-tier is leaving the plan's VRAM tier unused (#1581)
8bf3d84 JustVugg committed 2 months ago
fix(olmoe): keep --out as primary, add --outdir as alias
766dc97 yeduwuren2026 committed 2 months ago
fix(serve): an unpaired surrogate escape answered 500 "engine failed"
b77cefc kevin9327 committed 2 months ago
fix(serve): a non-object json_schema answered 500 "engine failed"
07259f2 kevin9327 committed 2 months ago
fix(coli): --gpu on DeepSeek V4 refused an install with only the DeepGEMM DLL
f13f460 kevin9327 committed 2 months ago
fix(planner): auto-tune advised colibri.c-only knobs for every engine
c5e5039 kevin9327 committed 2 months ago
fix(autotune): coli tune swept GLM-only CUDA knobs on every engine
d361ab3 kevin9327 committed 2 months ago
fix(xdna): skip the lane inside an OpenMP team
e802919 Kenneth-Javier Ortigoza committed 2 months ago
Merge pull request #1326 from kreuzzelg/qwen36-size-aware-descriptor
a90bed9 Vincenzo Fornaro committed 2 months ago
Merge pull request #1563 from kevin9327/fix/inkling-dense-convert-windows
70e7ddd Vincenzo Fornaro committed 2 months ago
Merge pull request #1562 from kevin9327/fix/datapoint-fresh-utf8
8897407 Vincenzo Fornaro committed 2 months ago
Merge pull request #1561 from kevin9327/fix/autotune-utf8-engine-output
8aaf70a Vincenzo Fornaro committed 2 months ago
Merge pull request #1560 from kevin9327/fix/coli-run-olmoe-utf8-prompt
d8972e3 Vincenzo Fornaro committed 2 months ago
glm53: replay a bare tool-call turn as the model wrote it (#1576)
3821fcf JustVugg committed 2 months ago
fix(qwen36): the pre-init device-count probe must load the backend DLL
249ddc6 ZhiyangK committed 2 months ago
feat(qwen36): name a checkpoint by its geometry, and a converter that refuses what it cannot place
54eddbe kreuzzelg committed 2 months ago
fix(glm53): honour Mat.resident in the Vulkan gate; free vk in mat_release
dc55bf1 S. Eric Clark committed 2 months ago
tests: skip the cuda-test recipe checks when make is absent
b012817 SurefireStudios committed 2 months ago
glm53 vulkan: clamp SiLU*Up in the shared gate_up shader
9f9cc05 Gyanu Mayank committed 2 months ago
fix(inkling): the dense int4 converter could not finish on Windows
2f7bc9d kevin9327 committed 2 months ago