Run frontier MoE models on hardware you already own — pure C, zero deps, experts streamed from disk. Tiny engine, immense model. 🐦
C
Commits on main
Merge branch 'fix/advisory-variants' into fix/glm53-f32-want
5c305fe Marcello Costagliola committed 1 month ago
Merge remote-tracking branch 'upstream/dev' into fix/advisory-variants
62c45ee Marcello Costagliola committed 1 month ago
Merge pull request #1353 from monotophic/api/server-surfaces
1f9a852 Vincenzo Fornaro committed 1 month ago
Merge pull request #1763 from Kenneth-Javier/build/vk-obj-engine-tests
1db25fc Vincenzo Fornaro committed 1 month ago
Merge pull request #1789 from enitimeago/feat/glm53-prefill-cancel
29e3d4f Vincenzo Fornaro committed 1 month ago
Merge pull request #1316 from Avicennasis/fix/planner-cgroup-memory
ccd8d1c Vincenzo Fornaro committed 1 month ago
Merge pull request #1315 from Avicennasis/feat/qpack-installers
f17b2f3 Vincenzo Fornaro committed 1 month ago
Merge pull request #1323 from Avicennasis/feat/qwen36-qpack-engine
1794f70 Vincenzo Fornaro committed 1 month ago
Merge pull request #1343 from Avicennasis/feat/qwen36-qpack-loader
0fb39fd Vincenzo Fornaro committed 1 month ago
Merge pull request #1791 from Avicennasis/p/p9-anthropic-image-blocks
938424c Vincenzo Fornaro committed 1 month ago
Merge pull request #1787 from benmaster82/fix/openai-api-honesty-set
d140af5 Vincenzo Fornaro committed 1 month ago
Merge pull request #1786 from kevin9327/fix/image-url-part-shape
6fd47e1 Vincenzo Fornaro committed 1 month ago
Merge pull request #1783 from kevin9327/fix/glm53-text-part-type
1a39d82 Vincenzo Fornaro committed 1 month ago
Merge pull request #1782 from kevin9327/fix/history-tool-call-function
ecf3b2d Vincenzo Fornaro committed 1 month ago
anthropic: image blocks are served, and a tool_result's picture is not dropped
6fcb034 Léon Avic Simmons committed 1 month ago
test(planner): run the cgroup fixture tests on Linux only
78fb318 Léon Avic Simmons committed 2 months ago
quant: the f32 matmul runs eight fmaf chains at once, with the same bits on every FMA build (#442)
e783ff4 RayanR000 committed 1 month ago
feat(qwen36): report qpack dispatch counters at the end of engine runs
fe19113 Léon Avic Simmons committed 2 months ago
test(qwen36): Apple parity gates for the qpack Metal path under eviction
c97d1c3 Léon Avic Simmons committed 2 months ago
feat(qwen36): routed experts from a qpack container through bounded slots
ed53f7d Léon Avic Simmons committed 2 months ago
feat(metal): whole-slot buffers with offset-addressed affine dispatch
1517776 Léon Avic Simmons committed 2 months ago
tools(qwen36): snap-view generator to run qwen36 over a qpack container
307eb99 Léon Avic Simmons committed 2 months ago
feat(qwen36): unshift MLX full-gamma norm weights to the zero-centered form
592d93a Léon Avic Simmons committed 2 months ago
feat(qwen36): load MLX-affine dense weights from a qpack container
ab18e37 Léon Avic Simmons committed 2 months ago