Skip to content

Run frontier MoE models on hardware you already own — pure C, zero deps, experts streamed from disk. Tiny engine, immense model. 🐦

C

Commits on main

fix(k3-repack): rebuild cumulative index on resume
Mario Gutierrez committed 3 months ago
49994a2
fix(api): render Anthropic prompts per architecture
Mario Gutierrez committed 3 months ago
140d91c
Merge pull request #847 from JustVugg/fix/doctor-names-shard
Vincenzo Fornaro committed 3 months ago
a54b4da
fix(doctor): name the shard that failed to read
JustVugg committed 3 months ago
e64b483
Merge pull request #844 from JustVugg/fix/release-idempotent
Vincenzo Fornaro committed 3 months ago
c7ae787
Merge pull request #846 from JustVugg/fix/reasoning-effort
Vincenzo Fornaro committed 3 months ago
9bdb0d4
552c2eb
chore: version 1.5.0
JustVugg committed 3 months ago
8f512fc
Merge pull request #843 from JustVugg/dev
Vincenzo Fornaro committed 3 months ago
09bf2fc
Merge pull request #842 from JustVugg/docs/readme-roster
Vincenzo Fornaro committed 3 months ago
e323575
Merge pull request #841 from JustVugg/sec/hardening
Vincenzo Fornaro committed 3 months ago
65b3b1a
Merge pull request #839 from JustVugg/feat/deepseek-v4-perf
Vincenzo Fornaro committed 3 months ago
133925e
2e45ad3
Move the no-CUDA-flags guard from kimi_k3 to olmoe
ZacharyZcR committed 3 months ago
53b9959
bccdcb5
inkling: ring-buffer KV cache for sliding-window layers
Davide Panelli committed 3 months ago
7fefa8c
Untrack the bench binary my own PR committed
ZacharyZcR committed 3 months ago
9fc95f9
80b887e