Skip to content

Run frontier MoE models on hardware you already own — pure C, zero deps, experts streamed from disk. Tiny engine, immense model. 🐦

C

ci: the partial-inkling-mimo families install the oracle requirements (Inkling's fixture needs torch), as dense-only-inkling-mimo-kimi does

JustVuggc74bb85dcae2
diff --git a/.github/workflows/ci.yml b/.github/workflows/ci.yml
index b163f21f..6e2af451 100644
--- a/.github/workflows/ci.yml
+++ b/.github/workflows/ci.yml
@@ -346,10 +346,10 @@ jobs:
# under ASan and UBSan
- family: partial-inkling-mimo
req: c/tools/requirements-kimi-k3-tiny.txt
- extra: pillow
+ extra: -r c/tools/oracle-requirements.txt pillow
- family: partial-inkling-mimo-sanitize
req: c/tools/requirements-kimi-k3-tiny.txt
- extra: pillow
+ extra: -r c/tools/oracle-requirements.txt pillow
# big prompt chunks and expert streaming (docs/vulkan.md): every chain engine on a
# prompt past its usual block, the chunk from the budget, a forced small chunk and
# streaming threshold, staged, the feature off, and the forced runs under ASan