Skip to content

Run frontier MoE models on hardware you already own — pure C, zero deps, experts streamed from disk. Tiny engine, immense model. 🐦

C

Merge remote-tracking branch 'upstream/dev' into ci/metal-test

Gourav Kargwal279379dd2c9d
diff --cc .github/workflows/ci.yml
index 92a9e17e,838a9bbf..d8f48668
--- a/.github/workflows/ci.yml
+++ b/.github/workflows/ci.yml
@@@ -190,23 -193,30 +193,46 @@@ jobs
echo "::endgroup::"
done
exit $rc
+ - if: matrix.os == 'macos-latest'
+ name: Metal backend tests
+ # The Metal backend suite is its own target (metal-test) and is not
+ # part of `make check`: TEST_BINS is derived from tests/test_*.$(EXE)
+ # rules, and backend_metal_test is built/run by the metal-test target
+ # itself. Nothing in CI exercised it until issue #940 shipped a
+ # compile error in it, so run it explicitly on the Apple Silicon
+ # runners.
+ # The runner's Apple Paravirtual device hangs on Metal submissions
+ # (observed: 47 min vs a 5-6 min normal run), so the test harness
+ # detects it and skips GPU execution with an explicit line; this
+ # timeout is the backstop that turns any residual hang into a red X.
+ timeout-minutes: 10
+ run: |
+ cd c
+ make metal-test
+ # macOS is the newest COLI_V4_SUPPORTED platform and the only one whose
+ # engine coverage lives solely in this job (Linux has the v4-tiny job in
+ # check.yml, Windows was first exercised at the release tag). The tiny
+ # oracle is the token-exactness gate: it fails on any numerical or I/O
+ # divergence, which is exactly what a platform port can break.
+ #
+ # The check target REGENERATES the fixture (--force) before comparing,
+ # so it needs the same pinned torch/transformers the Linux v4-tiny job
+ # installs -- without them the step dies in generation, not in the
+ # oracle (round 2 of this PR measured exactly that).
+ - uses: actions/setup-python@v5
+ if: matrix.os == 'macos-latest'
+ with:
+ python-version: '3.13'
+ cache: pip
+ cache-dependency-path: c/tools/requirements-deepseek-v4-tiny.txt
+ - name: Install pinned tiny-fixture dependencies (macOS)
+ if: matrix.os == 'macos-latest'
+ run: python -m pip install -r c/tools/requirements-deepseek-v4-tiny.txt
+ - name: DeepSeek V4 tiny oracle (macOS)
+ if: matrix.os == 'macos-latest'
+ run: make -C c deepseek-v4-tiny-check
+
# The Windows backend-DLL loader contract (c/tests/test_backend_loader.py)
# had no CI anywhere: the `python` job below is Linux-only, where these
# tests do not apply. They need no GPU and no HIP SDK — the fixtures are