Run frontier MoE models on hardware you already own — pure C, zero deps, experts streamed from disk. Tiny engine, immense model. 🐦
C
Commits on main
cuda: decode expert groups take the grouped kernels even under TC_W4A16 (#431)
34f6e50 ZacharyZcR committed 4 months ago
cuda: COLI_CUDA_ROUTER=1 — route the decode row on the layer's home device (#431 PR-A)
113ece3 ZacharyZcR committed 4 months ago
E5: hazard-audit round-2 fixes (re-register set hygiene, SUMMARY mutex ref)
8efa9ec monotophic committed 4 months ago
E5: carry the fslab-OOM unwind fix (unregister before free)
e011092 monotophic committed 4 months ago
E5: validator round-1 fixes (resset mutex split, flush visibility, citations)
82d0600 monotophic committed 4 months ago
E5: moe_submit relies on the residency set instead of per-buffer useResource:
309f20c monotophic committed 4 months ago
E5: MTLResidencySet lifecycle scaffolding (init/register/unregister/shutdown)
0049ea1 monotophic committed 4 months ago
README: vision, the JIT-for-weights framing, roadmap, acknowledgements
22560ad ZacharyZcR committed 4 months ago
site: redesign — measured atlas everywhere, vision, algorithm, models
bca4e95 ZacharyZcR committed 4 months ago
site: official website — animated demo, expert brain, 3-D atlas, Pages deploy
3e45074 ZacharyZcR committed 4 months ago
cuda: cache layernorm weights on-device in pipe_layer_sparse (kill 152 sync H2D/token) + overlap-window profiling counters
1d9f554 ZacharyZcR committed 4 months ago
cuda: COLI_GROUP_ASYNC=1 — async expert-group issue/take with CPU/GPU overlap at decode (opt-in, +6-8% measured)
ab55f49 ZacharyZcR committed 4 months ago
fix: MTP-head probe uses the last expert by index, not a hardcoded 255
4586d33 Nicholas Beerbower committed 4 months ago
Added Dockerfile and instructions for using Colibrì through a docker container
27b4c42 Davide Quack committed 4 months ago
Dual-SSD streaming: COLI_MODEL_MIRROR reads experts from two model copies
63966ba Steve Markgraf committed 4 months ago
Merge remote-tracking branch 'upstream/dev' into feat/hip-single-source
aa62ffd noobdev-ph committed 4 months ago
Merge remote-tracking branch 'upstream/main' into feat/gpu-backend-hardening
468b190 noobdev-ph committed 4 months ago
Merge remote-tracking branch 'upstream/main' into feat/hip-single-source
2760917 noobdev-ph committed 4 months ago
Merge pull request #391 from ZacharyZcR/refactor/split-colibri
61004dc Vincenzo Fornaro committed 4 months ago
plan: auto-tune heuristics — bottleneck classification + parameter decisions
8a9a0fc ZacharyZcR committed 4 months ago
fix: update test_logit_nan to include colibri.c instead of glm.c
083fda5 ZacharyZcR committed 4 months ago
fix: remove duplicate argmax_v — use NaN-safe version from sample.h
bc69a9a ZacharyZcR committed 4 months ago
docs: add simplified Chinese and Italian README, update language nav
420a072 ZacharyZcR committed 4 months ago