Run frontier MoE models on hardware you already own — pure C, zero deps, experts streamed from disk. Tiny engine, immense model. 🐦
C
Commits on main
fix(windows): validate the configured HIP runtime directory
fc21992 Kenneth-Javier Ortigoza committed 3 months ago
test(loader): prove same-process HIP runtime binding
c1bda85 Kenneth-Javier Ortigoza committed 3 months ago
test(loader): add controlled Windows HIP DLL fixtures
78d2a39 Kenneth-Javier Ortigoza committed 3 months ago
test(loader): give the backend-DLL contract its own owner
75cfda8 Kenneth-Javier Ortigoza committed 3 months ago
test(cuda): assert the real COLI_CUDA opt-in contract
f1e47aa Kenneth-Javier Ortigoza committed 3 months ago
fix(windows): select the HIP backend DLL in HIP mode
841ee23 Kenneth-Javier Ortigoza committed 3 months ago
build(windows): add an opt-in native HIP DLL build
6efd3c9 Kenneth-Javier Ortigoza committed 3 months ago
docs(experiments): the CPU read ceiling, llama.cpp, determinism, and a refuted hypothesis
3159c0f Nicolas committed 3 months ago
Merge pull request #792 from JustVugg/feat/kimi-usage-history
7fb1159 Vincenzo Fornaro committed 3 months ago
Merge pull request #793 from ThefloorMiner/fix/expert-bytes-probe-widest
0797f18 Vincenzo Fornaro committed 3 months ago
fix(kimi): serve blamed the payload for a tokenizer without XTML tokens
36a34c5 JustVugg committed 3 months ago
fix(plan): size the expert slot by the widest width the container holds
7c28e18 Nicolas committed 3 months ago
feat(kimi): learn from use — .coli_usage, autopin and decay, as GLM has
9212eff JustVugg committed 3 months ago
Merge pull request #784 from dyKiU/bugfix/inkling-cache-capacity-regression
44d7958 Vincenzo Fornaro committed 3 months ago
Merge pull request #762 from kreuzzelg/cuda-async-grouped-int4
8c8e2c7 Vincenzo Fornaro committed 3 months ago
Merge pull request #787 from JustVugg/feat/kimi-kv-prefix
d3bc866 Vincenzo Fornaro committed 3 months ago
Merge pull request #763 from RDouglasSharp/metal-prefill-on-dev
5b79fc9 Vincenzo Fornaro committed 3 months ago
fix(kimi): grow Lc/Rc instead of restarting them, or reuse never fires
863139e JustVugg committed 3 months ago
feat(kimi): reuse the attention state a previous turn already built; stop leaking Lc/Rc
d14b09d JustVugg committed 3 months ago
Merge pull request #791 from bherald/fix/omp-physical-cores
89472cb Vincenzo Fornaro committed 3 months ago
Merge pull request #786 from JustVugg/feat/inkling-kv-prefix
846b148 Vincenzo Fornaro committed 3 months ago
Merge pull request #785 from JustVugg/fix/783-engine-aware-doctor
414c027 Vincenzo Fornaro committed 3 months ago
Merge pull request #781 from terrizoaguimor/harden/st-read-raw-contract
e6b8899 Vincenzo Fornaro committed 3 months ago
fix(test): keep the generated payload as bytes, never as str
9278a21 JustVugg committed 3 months ago