Run frontier MoE models on hardware you already own — pure C, zero deps, experts streamed from disk. Tiny engine, immense model. 🐦
C
Commits on main
Merge pull request #1743 from JustVugg/fix/brio-serve-fixture
87ebe05 Vincenzo Fornaro committed 1 month ago
fix(experiments): a manifest that is not a JSON object crashed the validator
1c48c85 kevin9327 committed 1 month ago
test(brio): run the serve gates in CI, against the converted fixture
83ac21b JustVugg committed 1 month ago
fix(cluster): a numeric node_id killed every topology and health request
e0074b2 kevin9327 committed 1 month ago
Merge pull request #1356 from monotophic/evidence/ablate-block
b2f0921 Vincenzo Fornaro committed 1 month ago
Merge pull request #1738 from JustVugg/docs/changelog-1121-count
33814d7 Vincenzo Fornaro committed 1 month ago
brio: default normalize to sum; warn when mean mixes option token counts
8298d71 Taras Zubar committed 1 month ago
Merge pull request #1261 from Kenneth-Javier/feat/windows-xdna-shared-expert-lane
842dbb8 Vincenzo Fornaro committed 1 month ago
CHANGELOG 1.12.1: correct the pull request count (96, 80 from contributors)
4811021 JustVugg committed 1 month ago
Merge pull request #1736 from JustVugg/release/1.12.1-notes-wave6
1f42b14 Vincenzo Fornaro committed 1 month ago
Merge branch 'dev' into feat/windows-xdna-shared-expert-lane
04775f8 Kenneth-Javier Ortigoza committed 1 month ago
Merge pull request #1737 from JustVugg/ci/macos-timeout
a44865f Vincenzo Fornaro committed 1 month ago
Merge branch 'dev' into feat/windows-xdna-shared-expert-lane
cc3fd77 Kenneth-Javier Ortigoza committed 1 month ago
Merge pull request #1716 from jtinbergen/sse41-tier-upstream-next-v2
53ca388 Vincenzo Fornaro committed 1 month ago
Merge pull request #1730 from mfethe1/perf/dsv4-fp4-neon-arm
20e4582 Vincenzo Fornaro committed 1 month ago
Merge pull request #1734 from tarazum/fix/heat-save-stdin-drain
50c9e16 Vincenzo Fornaro committed 1 month ago
Merge pull request #1735 from JustVugg/fix/build-config-make381
78d56c2 Vincenzo Fornaro committed 1 month ago
close(): decide the hard-stop ladder by poll(), not by TimeoutExpired
f5497c8 Taras Zubar committed 1 month ago
Merge pull request #1731 from bokiko/fix/v4-cuda-arch-stamp
2516472 Vincenzo Fornaro committed 1 month ago
Merge pull request #1728 from crichalchemist/vk-link-colibri-tests
d23e362 Vincenzo Fornaro committed 1 month ago
Merge pull request #1726 from kevin9327/fix/inkling-windows-ram-probe
a8de807 Vincenzo Fornaro committed 1 month ago
Merge pull request #1717 from enitimeago/feat/web-continue
6b5671c Vincenzo Fornaro committed 1 month ago
build(ablate): list the headers the two ablation test rules reach
0f6511a monotophic committed 1 month ago