Run frontier MoE models on hardware you already own — pure C, zero deps, experts streamed from disk. Tiny engine, immense model. 🐦
C
Commits on main
Merge pull request #1715 from namespaceMarcello/test/glm53-harness-discovery
7a5bdee Vincenzo Fornaro committed 1 month ago
Merge pull request #1714 from benmaster82/fix/brio-options-state-pin
e2de147 Vincenzo Fornaro committed 1 month ago
Merge pull request #1719 from benmaster82/feat/brio-web-cancel-and-cli-dedup
017fe1b Vincenzo Fornaro committed 1 month ago
Merge pull request #1720 from monotophic/api/seed-accepted
de563da Vincenzo Fornaro committed 1 month ago
Merge pull request #1721 from monotophic/serve/checked-engine-writes
97622ad Vincenzo Fornaro committed 1 month ago
Merge pull request #1646 from Stamina9/codex/fix-qwen38-parallel-fallback
66167b6 Vincenzo Fornaro committed 1 month ago
Merge dev: keep #1102's fp8_format.h, #1395's exact_dot.h and the new CPU-only test rules next to this branch's sse41_kernels.h and SSE4.1 gates
621ae67 JustVugg committed 1 month ago
Merge pull request #1102 from monotophic/f8/absorb-fmt8
1d7defa Vincenzo Fornaro committed 1 month ago
Merge dev: colibri prerequisites keep exact_dot.h (#1395) and fp8_format.h
b4e51d5 JustVugg committed 1 month ago
Merge branch 'dev' into feat/windows-xdna-shared-expert-lane
e4fbd65 Kenneth-Javier Ortigoza committed 1 month ago
Merge pull request #1395 from rybruscoe/exact-verify-689
d9e7bea Vincenzo Fornaro committed 1 month ago
Merge pull request #1709 from kevin9327/fix/web-regenerate-drops-images
7a82be4 Vincenzo Fornaro committed 1 month ago
Merge pull request #1711 from kevin9327/r8b-win-cuda-dll-probe
f89040b Vincenzo Fornaro committed 1 month ago
ci(windows): build the engines with XDNA=1, as the release does
6368f28 Kenneth-Javier Ortigoza committed 1 month ago
Merge dev: fallback diagnostics on the heap-allocated batch of #1686
c07f62c JustVugg committed 1 month ago
Merge dev: keep dev's build-flags stamp (#1707) and serve_budget.h (#1712) next to this branch's header
bf4ac29 JustVugg committed 1 month ago
Merge dev: keep dev's build-flags stamp (#1707) and serve_budget.h (#1712) next to this branch's header
77e6a0d JustVugg committed 1 month ago
Merge pull request #1708 from wittchen/fix/glm53-vk-fprintf
c1746e0 Vincenzo Fornaro committed 1 month ago
Merge pull request #1707 from namespaceMarcello/fix/v4-unit-flags-stamp
c0a3fb4 Vincenzo Fornaro committed 1 month ago
Merge pull request #1713 from kevin9327/fix/planner-kimi-expert-gb
72e49d2 Vincenzo Fornaro committed 1 month ago
Merge pull request #1712 from kevin9327/fix/k3-ink-olmoe-max-tokens-ceiling
3431e87 Vincenzo Fornaro committed 1 month ago
Merge pull request #1710 from kevin9327/fix/serve-tool-function-non-object
b8869a2 Vincenzo Fornaro committed 1 month ago
kimi_k3: keep K3_CUDA the only engine switch; coli maps --gpu onto it
2bc08d0 JustVugg committed 1 month ago
feat(brio): let the web cancel a scoring run, dedupe the CLI options
d13dec7 benmaster82 committed 1 month ago
Merge branch 'dev' into sse41-tier-upstream-next-v2 (+25 commits)
dd1cf4e Jaapjan Tinbergen committed 1 month ago
fix(brio): pin the shared state in the options form so per-question requests reuse it
e1feb15 benmaster82 committed 1 month ago
test(glm53): rename the harnesses out of the unittest glob, run the tiny oracles in CI
69c3b0f Marcello Costagliola committed 1 month ago
fix(planner): export K3_EXPERT_GB and GLM53_EXPERT_GB from the plan
b1b9c60 kevin9327 committed 1 month ago
fix(serve): kimi, inkling, olmoe clamp max_tokens to the context
1627377 kevin9327 committed 1 month ago
fix(coli): Windows GPU probe missed Kimi CUDA_DLL and HIP hosts
6d616c5 kevin9327 committed 1 month ago