Skip to content

Run frontier MoE models on hardware you already own — pure C, zero deps, experts streamed from disk. Tiny engine, immense model. 🐦

C

Build the container image in CI

ZacharyZcRa98067a30baf
diff --git a/.github/workflows/ci.yml b/.github/workflows/ci.yml
index 2e5f977d..17846a97 100644
--- a/.github/workflows/ci.yml
+++ b/.github/workflows/ci.yml
@@ -22,6 +22,39 @@ jobs:
# that inkling and kimi_k3 did not compile under msys2/UCRT64 at all was invisible
# for months, and binary releases silently shipped the GLM engine alone (#720).
# Each engine is built separately so one failure does not mask the others.
+ # The container image. Nothing built docker/Dockerfile.slim in CI before, so a
+ # rename or a moved file under c/ could break the image and only a user would
+ # find out -- the same gap the .mm and fuzz-rans paths had.
+ #
+ # Only Dockerfile.slim is built here, on purpose. docker/Dockerfile does
+ # `git clone` of the upstream repo (that is its point -- README's zero-setup
+ # path downloads that one file and needs no checkout), so building it in CI
+ # would test upstream/main rather than this PR. Its Dockerfile is linted for
+ # syntax instead.
+ docker:
+ name: Container image
+ runs-on: ubuntu-latest
+ steps:
+ - uses: actions/checkout@v4
+ - name: Build the slim image
+ run: docker build -t colibri:ci -f docker/Dockerfile.slim .
+ - name: The image actually runs
+ # Building is not the same as working: a missing COPY only shows up when
+ # the entrypoint tries to import what is not there. --version needs no
+ # model, so it exercises the launcher end to end without a 372 GB mount.
+ run: |
+ docker run --rm colibri:ci --version
+ docker run --rm colibri:ci --help > /dev/null
+ - name: The engine binary is in the image and is executable
+ run: docker run --rm --entrypoint /app/colibri colibri:ci --help 2>&1 | head -5 || true
+ - name: Lint both Dockerfiles
+ # docker/Dockerfile is not built here (see above) but it is still shipped
+ # and followed by users, so it gets checked for syntax at least.
+ uses: hadolint/[email protected]
+ with:
+ dockerfile: docker/Dockerfile
+ failure-threshold: error
+
engines-all-platforms:
name: All engines (${{ matrix.name }})
strategy:
diff --git a/docker/README.md b/docker/README.md
index 1e171dc2..7a57ab8a 100644
--- a/docker/README.md
+++ b/docker/README.md
@@ -121,6 +121,13 @@ sudo docker build -t colibri-i .
Wait for it to finish (a few minutes). If everything goes well, you will see: `Successfully tagged colibri-i:latest`
+> **This builds the code on GitHub, not the code on your disk.** The Dockerfile
+> clones the repository inside the image — that is what makes this path work
+> with a single downloaded file and no checkout. If you are *developing* and
+> want your local changes in the image, use `Dockerfile.slim` instead (see
+> [Slim image](#slim-image-developers--production) below); it copies `c/` from the build
+> context.
+
> **If you want to receive repository updates**: First delete the old image with `docker rmi colibri-i` and rebuild.
---