Skip to content

Run frontier MoE models on hardware you already own — pure C, zero deps, experts streamed from disk. Tiny engine, immense model. 🐦

C

Commits on main

fix(windows): validate the configured HIP runtime directory
Kenneth-Javier Ortigoza committed 3 months ago
fc21992
test(loader): prove same-process HIP runtime binding
Kenneth-Javier Ortigoza committed 3 months ago
c1bda85
test(loader): add controlled Windows HIP DLL fixtures
Kenneth-Javier Ortigoza committed 3 months ago
78d2a39
test(loader): give the backend-DLL contract its own owner
Kenneth-Javier Ortigoza committed 3 months ago
75cfda8
test(cuda): assert the real COLI_CUDA opt-in contract
Kenneth-Javier Ortigoza committed 3 months ago
f1e47aa
fix(windows): select the HIP backend DLL in HIP mode
Kenneth-Javier Ortigoza committed 3 months ago
841ee23
build(windows): add an opt-in native HIP DLL build
Kenneth-Javier Ortigoza committed 3 months ago
6efd3c9
7fb1159
de4aa66
docs: acknowledge inference research foundations
ZacharyZcR committed 3 months ago
99cd640
docs: publish GLM-5.2 inference research closeout
ZacharyZcR committed 3 months ago
56c03a1
cuda: add paged ragged KV research runtime
ZacharyZcR committed 3 months ago
2c5be24
8c8e2c7
Merge pull request #787 from JustVugg/feat/kimi-kv-prefix
Vincenzo Fornaro committed 3 months ago
d3bc866
2f8957c
5b79fc9
Merge pull request #791 from bherald/fix/omp-physical-cores
Vincenzo Fornaro committed 3 months ago
89472cb
Merge pull request #786 from JustVugg/feat/inkling-kv-prefix
Vincenzo Fornaro committed 3 months ago
846b148
414c027
Merge pull request #782 from mgua/dev
Vincenzo Fornaro committed 3 months ago
7fad591