Run frontier MoE models on hardware you already own — pure C, zero deps, experts streamed from disk. Tiny engine, immense model. 🐦
C
Commits on main
Merge pull request #989 from ZacharyZcR/fix/933-eslot-inflight
b4b182b Vincenzo Fornaro committed 3 months ago
refactor(v4): vendor the checkpoint's DSML primitives behind #948's tool calling
3d1c3be dcutugno committed 3 months ago
Merge pull request #993 from JustVugg/fix/host-allowlist-wildcard
c9867a7 Vincenzo Fornaro committed 3 months ago
fix(server): let an operator reach a public bind — --allowed-host '*' (#990)
02e5b0b JustVugg committed 3 months ago
DeepSeek V4: the CUDA kernels, as a tier rather than an engine
3cc2420 ZacharyZcR committed 3 months ago
fix(v4/mirror): update test for v4_read_expert_record with rep parameter
22ef387 dcutugno committed 3 months ago
fix(v4/mirror): use linear-index hash for balanced expert routing
725ead5 dcutugno committed 3 months ago
feat(v4): dual-SSD mirror (COLI_MODEL_MIRROR) for the expert store
2e65c13 dcutugno committed 3 months ago
Merge pull request #985 from JustVugg/fix/olmoe-stream-drop
417620d Vincenzo Fornaro committed 3 months ago
fix(server): OLMoE streaming dropped the answer into reasoning (#984)
88a7565 JustVugg committed 3 months ago
Merge pull request #980 from JustVugg/fix/chat-reasoning
7647a3b Vincenzo Fornaro committed 3 months ago
fixup: fork+exec the pty child — bare fork from a threaded test deadlocks
de0f71f JustVugg committed 3 months ago
Merge pull request #967 from terrizoaguimor/fix/pilot-lru-sentinel
64eb7ac Vincenzo Fornaro committed 3 months ago
Merge pull request #974 from Blakeolson21/blake/ci-windows-focused
c874fff Vincenzo Fornaro committed 3 months ago
Merge pull request #982 from Blakeolson21/blake/v4-print-omp-team
7677695 Vincenzo Fornaro committed 3 months ago