Run frontier MoE models on hardware you already own — pure C, zero deps, experts streamed from disk. Tiny engine, immense model. 🐦
C
ci(windows): build the engines with XDNA=1, as the release does
Kenneth-Javier Ortigoza6368f287ed5f
diff --git a/.github/workflows/ci.yml b/.github/workflows/ci.ymlindex 1669a01b..c807b0a0 100644--- a/.github/workflows/ci.yml+++ b/.github/workflows/ci.yml@@ -198,6 +198,11 @@ jobs:# GitHub shells are format strings: 'msys2 {0}', never bare 'msys2'.shell: "msys2 {0}"v4: "1"+ # The same make_args as release.yml's windows row, so the shipped+ # configuration is built here before a tag builds it for the first+ # time. XDNA=1 needs nothing installed on the runner: the lane's host+ # side links no XRT, and the helper is loaded at runtime on request.+ make_args: "XDNA=1"runs-on: ${{ matrix.os }}defaults:run:@@ -230,10 +235,32 @@ jobs:if [ "${{ matrix.v4 }}" = "1" ]; then ENGINES="$ENGINES deepseek-v4"; fifor t in $ENGINES; doecho "::group::$t"- make $t || { echo "FAILED: $t"; rc=1; }+ make $t ${{ matrix.make_args }} || { echo "FAILED: $t"; rc=1; }echo "::endgroup::"doneexit $rc+ - if: matrix.os == 'windows-latest'+ name: "The release configuration is what got built (XDNA=1)"+ run: |+ cd c+ # A switch that silently did nothing would still leave the loop above+ # green, so check the binary rather than the command line. Only an+ # XDNA=1 host carries the helper's name (its LoadLibraryExA argument),+ # and only a default host carries the "no XDNA support" answer.+ if ! grep -aq 'coli_xdna.dll' colibri.exe; then+ echo "FAIL: colibri.exe was built without the XDNA lane"; exit 1+ fi+ if grep -aq 'this build has no XDNA support' colibri.exe; then+ echo "FAIL: colibri.exe is the default build, not XDNA=1"; exit 1+ fi+ # The lane must not cost the ordinary download a dependency: XRT and+ # the helper are resolved at runtime, only when the user asks.+ imports=$(objdump -p colibri.exe | sed -n 's/.*DLL Name: //p' | tr 'A-Z' 'a-z')+ echo "$imports"+ if echo "$imports" | grep -Eq '^(xrt_core|xrt_coreutil|coli_xdna)\.dll'; then+ echo "FAIL: the XDNA=1 host imports XRT or the helper"; exit 1+ fi+ echo "OK: colibri.exe carries the XDNA lane and imports neither XRT nor the helper"- name: "Environment shims: setenv is visible to getenv in-process"run: |cd cdiff --git a/GPU_BACKENDS.md b/GPU_BACKENDS.mdindex 9b13eeb7..f21eed92 100644--- a/GPU_BACKENDS.md+++ b/GPU_BACKENDS.md@@ -212,7 +212,10 @@ uses, so output may differ.never include or link XRT. `XDNA=1` compiles them into the host and defines`COLI_XDNA`; the Windows release build uses it (`.github/workflows/release.yml`),because an `XDNA=1` host has the same import table as a default one and starts-normally on a machine with no NPU.+normally on a machine with no NPU. CI's Windows engine build uses the same+`make_args` (`.github/workflows/ci.yml`), so that configuration is compiled on+every change rather than first at a release tag, and a step there checks the+binary: the lane is present, and neither XRT nor the helper is imported.### Turning it on