Run frontier MoE models on hardware you already own — pure C, zero deps, experts streamed from disk. Tiny engine, immense model. 🐦
C
Commits on main
ci: prove the NEON FP4 arms bit-exact against the scalar arm on the ARM runner
4087d5a JustVugg committed 1 month ago
make: write .build-config through printf on GNU Make 3.x (#1732)
b6fbb65 JustVugg committed 1 month ago
Merge dev: keep dev's colibri prerequisites beside this branch's evidence_digest.h
fe50e71 monotophic committed 1 month ago
serve: give the engine its graceful exit — stdin drain, SIGBREAK, group isolation
49e72cd Taras Zubar committed 1 month ago
dsv4: NEON arm for coli_fp4_matvec_rows16_order (decode path, #1696)
75d2677 mfethe1 committed 1 month ago
fix(v4): rebuild backend_cuda_dsv4.o when the nvcc command changes
9ba9ed8 bokiko committed 1 month ago
feat(web): offer Continue only when /health reports continue_assistant
7743fb4 eni committed 1 month ago
Merge branch 'dev' into sse41-tier-upstream-next-v2 (+214 commits)
2c7979f Jaapjan Tinbergen committed 1 month ago
tests: link backend_vulkan.o into the engine-including tests under VK=1
37d9367 Courtney Andrew Richardson committed 1 month ago
fix(inkling): measure RAM on Windows so auto-cap is not 16 experts
c703d26 kevin9327 committed 1 month ago
Merge pull request #1725 from JustVugg/release/1.12.1-notes-1724
a2e578c Vincenzo Fornaro committed 1 month ago
Merge pull request #1724 from JustVugg/fix/qwen36-decode-added-tokens
20183ac Vincenzo Fornaro committed 1 month ago
Merge branch 'dev' into feat/windows-xdna-shared-expert-lane
35f3514 Kenneth-Javier Ortigoza committed 1 month ago
Merge pull request #1722 from JustVugg/release/1.12.1-notes-wave5
33422c3 Vincenzo Fornaro committed 1 month ago
Merge pull request #1286 from cameron/perf/sse41-grouped-int4-upstream
4aac292 Vincenzo Fornaro committed 1 month ago
test(serve): give the served-logprobs golden case a prompt that generates
9e0c825 monotophic committed 1 month ago
test(serve): pin the fault-STOP through the checked writer on a zero-progress write
0ddebe6 monotophic committed 1 month ago
Merge dev: take the seed acceptance (#1720) and the checked engine writes (#1721) under the logprobs work
5a07127 monotophic committed 1 month ago
refactor(sse41): collect grouped-int4 kernels in the shared header
3b24221 codex 20260923-120015-1331522267 committed 1 month ago
Merge branch 'dev' into feat/windows-xdna-shared-expert-lane
844dfca Kenneth-Javier Ortigoza committed 1 month ago