Run frontier MoE models on hardware you already own — pure C, zero deps, experts streamed from disk. Tiny engine, immense model. 🐦
C
Commits on main
fix(v4): use direct reads for per_matrix REAP expert records (#1615)
62702f2 Frank_zhu committed 2 months ago
docs(int4-rans256-g0): disambiguate expected_bytes identity vs extent (#1273)
96d2529 Frank_zhu committed 2 months ago
fix(tests): guard test_olmoe_dot_i8_16_sse41 to x86_64 too
a00a5c4 Jaapjan Tinbergen committed 2 months ago
fix(olmoe): move converter from GLM to OLMoE descriptor
41cb9a0 yeduwuren2026 committed 2 months ago
Merge pull request #1582 from JustVugg/fix/auto-tier-vram-notice
5a0b725 Vincenzo Fornaro committed 2 months ago
Merge pull request #1608 from JustVugg/fix/doctor-core-roles-v4
a536d96 Vincenzo Fornaro committed 2 months ago
Merge pull request #1555 from phreakocious/feat/prefill-decode-consistency
d5c68cb Vincenzo Fornaro committed 2 months ago
Merge pull request #1566 from gyanu2507/fix/glm53-vk-swiglu-clamp-on-dev
46296d5 Vincenzo Fornaro committed 2 months ago
Merge pull request #1613 from kreuzzelg/qwen36-tensor-kinds-provenance
4ce91a0 Vincenzo Fornaro committed 2 months ago
Merge pull request #1307 from BrianHeeseIs/upstream-pr/coli-stop-portable
91a8c8e Vincenzo Fornaro committed 2 months ago
Merge pull request #1603 from crichalchemist/vulkan-syncval-harness
e9a650b Vincenzo Fornaro committed 2 months ago
Merge pull request #1598 from kevin9327/fix/serve-tool-choice-non-object-function
43d7e86 Vincenzo Fornaro committed 2 months ago
Merge pull request #1599 from crichalchemist/macos-macports-libomp
f02c202 Vincenzo Fornaro committed 2 months ago
Merge pull request #1548 from phreakocious/fix/metal-device-fallback
e17dbb2 Vincenzo Fornaro committed 2 months ago
Merge pull request #1596 from SulimanAbdulrazzaq/fix/schema-array-item-rule
f56adf5 Vincenzo Fornaro committed 2 months ago
Merge pull request #1595 from SulimanAbdulrazzaq/fix/grammar-tail-frames
41cef59 Vincenzo Fornaro committed 2 months ago
tests(qwen36): provenance for the tensor-kind lists -- index hashes, the regenerating one-liner, an index-backed check
731359c kreuzzelg committed 2 months ago
fix(qwen36): refuse loudly on a failed encode-buffer realloc
d548042 Roman Dolgov committed 2 months ago
doctor: match core roles by component, not by one family's spelling (#1593)
be79e82 JustVugg committed 2 months ago
perf(quant): multi-row tile + AVX-512 + AMX arms for the K1b grouped IDOT
b4292dd Jude committed 2 months ago
qwen36: port CACHE_ROUTE with the VRAM tier as the first residency level
ec99181 Courtney Andrew Richardson committed 2 months ago
docs(vulkan): how to run the Khronos validation layers, and one layer defect
119266e Courtney Andrew Richardson committed 2 months ago
vulkan: keep the VK_TEST harness clean under synchronization validation
2b1e814 Courtney Andrew Richardson committed 2 months ago
vulkan: free the qprep scratch and per-layer norm buffers at shutdown
39b3832 Courtney Andrew Richardson committed 2 months ago
test(check_data_logprob_gaps): gate the transcript on the engine preamble and widen the numeric-tail check
da0c938 monotophic committed 2 months ago
feat(tools): add engine evidence preamble and banner helpers
998c800 monotophic committed 2 months ago