Run frontier MoE models on hardware you already own — pure C, zero deps, experts streamed from disk. Tiny engine, immense model. 🐦
C
Commits on main
Merge pull request #1461 from JustVugg/fix/cluster-worker-cap
f922c09 Vincenzo Fornaro committed 2 months ago
Merge pull request #1460 from JustVugg/fix/olmoe-prof-disk
9bae92a Vincenzo Fornaro committed 2 months ago
fix(coli): the cluster worker handed the engine the string "None" as its cap
15c2d98 JustVugg committed 2 months ago
fix(olmoe): measure the expert disk phase instead of reporting a zero
7592713 JustVugg committed 2 months ago
Merge pull request #1427 from ZH1995/fix/readme-formatting-error
e762360 Vincenzo Fornaro committed 2 months ago
Merge pull request #1454 from yuripourre/fix/qwen36-hip-tier
fc590c8 Vincenzo Fornaro committed 2 months ago
Merge pull request #1447 from trigger2k20/fix/mirror-verify-full-mirror
a2ab8d8 Vincenzo Fornaro committed 2 months ago
Merge pull request #1434 from njloof/fix/metal-fmt0-null-scales
fa26477 Vincenzo Fornaro committed 2 months ago
Merge pull request #1459 from JustVugg/hotfix-setenv
a6889c7 Vincenzo Fornaro committed 2 months ago
fix(tests): the qwen36 fill-wait test needs compat.h to build on Windows
0df0fa6 JustVugg committed 2 months ago
Merge pull request #1396 from dmoraesrs/feat/web-reasoning-drop-medium-glm53
ba268dd Vincenzo Fornaro committed 2 months ago
Merge pull request #1440 from texasich/fix/compat-direct-includes
e74d0d7 Vincenzo Fornaro committed 2 months ago
Merge pull request #1439 from bherald/test/resource-plan-sparse-fixtures-20260911
542a763 Vincenzo Fornaro committed 2 months ago
Merge pull request #1389 from bherald/fix/glm53-ehit-release
919cf51 Vincenzo Fornaro committed 2 months ago
Merge pull request #1421 from bherald/fix/windows-explicit-expert-budget
0d51666 Vincenzo Fornaro committed 2 months ago
Merge pull request #1388 from crichalchemist/qwen36-tier-review-followup
d9d773b Vincenzo Fornaro committed 2 months ago
Merge pull request #1390 from crichalchemist/qwen36-tier-fill-wait
2dac79e Vincenzo Fornaro committed 2 months ago
Merge pull request #1453 from JustVugg/feat/deepseek-v41-flash
fc73387 Vincenzo Fornaro committed 2 months ago
fix(deepseek-v41): build on Windows, and ship v41_dsml.py in the image
fe4f8a9 JustVugg committed 2 months ago
fix(deepseek-v41): coli run, the chat's stderr, and a missing header dependency
23f98cd JustVugg committed 2 months ago
fix(deepseek-v41): the attention block's scratch is bounded, and CI crosses it
8d1a7ab JustVugg committed 2 months ago
docs(deepseek-v41): what the blocking bought, and the two overlaps that did not
53669e2 JustVugg committed 2 months ago
perf(deepseek-v41): the MoE is expert-major, so a shared expert is read once
410842e JustVugg committed 2 months ago
perf(deepseek-v41): attention reads its matrices once per block, not once per token
7355ab0 JustVugg committed 2 months ago
perf(deepseek-v41): a step's expert misses go to the device together
871d793 JustVugg committed 2 months ago
perf(deepseek-v41): the FP8 and BF16 inner loops go through AVX2
39ca742 JustVugg committed 2 months ago
perf(deepseek-v41): drafting stays on, and the measurement that says so is cold
026c0c4 JustVugg committed 2 months ago