Run frontier MoE models on hardware you already own — pure C, zero deps, experts streamed from disk. Tiny engine, immense model. 🐦
C
Commits on main
Merge pull request #1817 from JustVugg/fix/tui-image-path-not-a-command
d91a4f1 Vincenzo Fornaro committed 1 month ago
coli chat: a line that starts with a picture's path is a message, not a command
761ce17 JustVugg committed 1 month ago
Merge pull request #1814 from JustVugg/fix/inkling-embed-norm-name
32f1cd2 Vincenzo Fornaro committed 1 month ago
inkling: read the embedding norm under the name transformers 5.18 writes
d493040 JustVugg committed 1 month ago
mimo: MiMo-V2.6 engine (Flash, Pro), text and vision, read as released
b290d5e JustVugg committed 1 month ago
api: `tool_choice: "required"` instructs the model on every engine
803c244 Yi-111-a committed 1 month ago
fix(api): stream the completions keepalive as a text chunk, not a delta
98957b7 benmaster82 committed 1 month ago
fix(web): interpolate the image alt count and repair the German image labels
5e82814 benmaster82 committed 1 month ago
dsv41_ref: top-k ties go to the lowest index, and the indexer never keeps -inf
1ffeb0b RayanR000 committed 1 month ago
serve: the modalities a model card claims are the ones the engine loaded
c60f78a Léon Avic Simmons committed 1 month ago
Merge branch 'dev' into build/makefile-autodeps
4baa66c Kenneth-Javier Ortigoza committed 1 month ago
Merge branch 'dev' into build/makefile-autodeps
58b1941 Kenneth-Javier Ortigoza committed 1 month ago
fix(serve): check tools and messages before rendering the chat prompt
ea8238f kevin9327 committed 1 month ago
matmul_f32.h: one vectorized f32 matmul for quant.h, olmoe, inkling and qwen36 (#442)
c875b9e RayanR000 committed 1 month ago
fix(api): return GLM-5.3 reasoning only when thinking is enabled
eae7b10 Suliman Abdulrazzaq committed 1 month ago
quant: pin the scalar fp8 chain fused (fmaf) on aarch64; full-mantissa test inputs
e2e3e0c Michael Feth committed 1 month ago
Merge pull request #1795 from JustVugg/fix/flaky-fault-stop-test
eefa57a Vincenzo Fornaro committed 1 month ago
Merge pull request #1790 from RayanR000/perf/442-f32-matmul
a829e99 Vincenzo Fornaro committed 1 month ago
Merge pull request #1794 from JustVugg/feat/qwen36-tool-calling
af15084 Vincenzo Fornaro committed 1 month ago
tests: the failed-STOP test waits for the STOP, not for 0.15 s
f6665f3 JustVugg committed 1 month ago