Run frontier MoE models on hardware you already own — pure C, zero deps, experts streamed from disk. Tiny engine, immense model. 🐦
C
Commits on main
build: integrate V4 targets and tests with the current colibri tree
2430625 DrewZ committed 4 months ago
v4: restore model-specific tensor, safetensors and native-quant infrastructure
1e77016 DrewZ committed 4 months ago
Merge pull request #521 from JustVugg/docs/get-started-restructure
dce7012 Vincenzo Fornaro committed 4 months ago
Merge pull request #519 from JustVugg/fix/program-name-ascii
14dbe9c Vincenzo Fornaro committed 4 months ago
name: the program is 'colibri', plain ASCII — banner, --version, release title
7bb7efa JustVugg committed 4 months ago
Merge pull request #516 from JustVugg/fix/release-verify-accent
2f770be Vincenzo Fornaro committed 4 months ago
release: the verify grep must survive the accent — the banner says colibrì, not colibri
2acf535 JustVugg committed 4 months ago
Merge pull request #515 from JustVugg/docs/release-archive-no-rename
d88737c Vincenzo Fornaro committed 4 months ago
docs: the engine is colibri(.exe) everywhere — kill the obsolete rename step
10d9b58 JustVugg committed 4 months ago
Merge pull request #513 from JustVugg/fix/509-coli-temp-env
3cd675a Vincenzo Fornaro committed 4 months ago
Merge pull request #512 from JustVugg/fix/release-workflow-engine-rename
405e7bc Vincenzo Fornaro committed 4 months ago
sampling: move the temperature channel to COLI_TEMP — $TEMP belongs to ROCm and Windows (#509)
8040798 JustVugg committed 4 months ago
release: build and copy the engine under its real name (glm -> colibri)
b3b6e8d JustVugg committed 4 months ago
Merge pull request #508 from JustVugg/fix/release-package-engine-name
008ecc3 Vincenzo Fornaro committed 4 months ago
release: ship the engine under its plain name so the archive actually runs
767bf75 JustVugg committed 4 months ago
Merge pull request #507 from JustVugg/release/v1.1.0-bump
e7e5723 Vincenzo Fornaro committed 4 months ago
Merge pull request #505 from JustVugg/fix/401-unclosed-tool-call
d633b35 Vincenzo Fornaro committed 4 months ago
serve: recover a tool call whose closing tag never arrives (#401)
e2cad79 JustVugg committed 4 months ago
Merge pull request #506 from JustVugg/fix/401-context-truncation
8c8c798 Vincenzo Fornaro committed 4 months ago
serve: refuse an over-long prompt instead of silently truncating it (#401)
b06affd JustVugg committed 4 months ago
Metal: chunk coli_metal_gemm to fix grid-size truncation at large prefill
a0b929c Doug Sharp committed 4 months ago