Skip to content

Run frontier MoE models on hardware you already own — pure C, zero deps, experts streamed from disk. Tiny engine, immense model. 🐦

C

Commits on main

serve: split Anthropic thinking response blocks
winklemad committed 4 months ago
996a1a9
db5b466
MTP: auto draft depth 1, not 3
recviking committed 4 months ago
a7c859c
052fd67
test: fix CUDA env test for colibri rename + CPU-only CI
Hermes Quant Auditor committed 4 months ago
6a92177
2354540
Remove google redirect from links
Maxwell D Collins committed 4 months ago
182b6d4
Merge pull request #312 from nbeerbower/inkling
Vincenzo Fornaro committed 4 months ago
e4b5bf3
ci: build inkling + token-exact oracle in CI
Nicholas Beerbower committed 4 months ago
2c396d8
inkling: docs/inkling.md + honest usage-save reporting
Nicholas Beerbower committed 4 months ago
6ebac54
inkling: make cache warming toggleable
Nicholas Beerbower committed 4 months ago
9210904
deb3bd0
inkling: spin-sync device flag + phase timers
Nicholas Beerbower committed 4 months ago
d4f1145