Run frontier MoE models on hardware you already own — pure C, zero deps, experts streamed from disk. Tiny engine, immense model. 🐦
C
Commits on main
docs(env): all nine engines in the reference, V4.1 gets its own section
7b25fa1 JustVugg committed 1 month ago
tok.h: the DeepSeek V4/V4.1 pre-tokenizer, so Turkish tokenizes like HF
101c6a1 JustVugg committed 1 month ago
docs/experiments: GLM-5.3 batched prefill, full-model measurement
92386b9 JackKnifeAI committed 1 month ago
Merge pull request #1767 from JustVugg/fix/qwen36-preserve-thinking
0e85efb Vincenzo Fornaro committed 1 month ago
Merge pull request #1768 from JustVugg/docs/weights-from-disk
9845892 Vincenzo Fornaro committed 1 month ago
docs(env): document the weights-from-disk options, fix COLI_MMAP
a6acc35 JustVugg committed 1 month ago
qwen36: render the template's preserve_thinking so standard clients get KV prefix reuse
acf7044 JustVugg committed 1 month ago
glm53: batch the dense prefill path, bit-identical per token
db7475f JackKnifeAI committed 1 month ago
fix(api): keep GLM-5.3 reasoning out of the /v1/messages answer
e0001c2 Suliman Abdulrazzaq committed 1 month ago
tests: read EXE without --eval, and see every link line
0b256d0 Kenneth-Javier Ortigoza committed 1 month ago
tests: decide the VK_OBJ need with the preprocessor
dddd94f Kenneth-Javier Ortigoza committed 1 month ago
tests: link $(VK_OBJ) into the rest of the engine-including rules
9312b07 Kenneth-Javier Ortigoza committed 1 month ago
build(vk): link the Vulkan loader on Windows under -static
ad65a59 Kenneth-Javier Ortigoza committed 1 month ago
fix(qwen36): don't evict an expert a moe run is still reading
c57e527 Marcello Costagliola committed 1 month ago
fix(qwen36): same logits at every expert-cache capacity on FMA builds
28e444e Marcello Costagliola committed 1 month ago
build: generate header prerequisites for the rest of the gcc rules
fbeef6a Kenneth-Javier Ortigoza committed 1 month ago
Merge pull request #1753 from tarazum/fix/brio-normalize-default
4e28e39 Vincenzo Fornaro committed 1 month ago
build: say why the AUTODEP_ELSEWHERE tests keep their lists
104d63c Kenneth-Javier Ortigoza committed 1 month ago
test: check the one-unit rule in every build flavour
45dfb4d Kenneth-Javier Ortigoza committed 1 month ago
build: compile the tests' helper sources to objects
d9ad16b Kenneth-Javier Ortigoza committed 1 month ago
build: address review of the generated-deps change
081d28d Kenneth-Javier Ortigoza committed 1 month ago
test: follow the qwen36 tier variable to its new name
ebdb591 Kenneth-Javier Ortigoza committed 1 month ago
build: generate header prerequisites with -MMD -MP (#1741)
86215ce Kenneth-Javier Ortigoza committed 1 month ago
test(glm53): run the serve and pin_branch harnesses in the oracle job
c5581d4 eni committed 1 month ago
feat(glm53): log CANCEL with emitted and filled under GLM53_VERBOSE
30ad94b eni committed 1 month ago
test(glm53): skip EMAP in the serve harness's mid-turn CANCEL loop
ce8591a eni committed 1 month ago
Merge pull request #1751 from enitimeago/fix/glm53-pin-branch-restore
499757d Vincenzo Fornaro committed 1 month ago