Run frontier MoE models on hardware you already own — pure C, zero deps, experts streamed from disk. Tiny engine, immense model. 🐦
C
Commits on main
fix(coli): coli chat hung once an engine stderr line did not fit the locale
9ba259d kevin9327 committed 2 months ago
fix(glm53): refuse an over-long serve prompt with CONTEXT_EXCEEDED
5ea97e8 kevin9327 committed 2 months ago
vulkan: reserve the expert tier's RAM on integrated GPUs (#653 for the VK path)
772f961 huppiflupp committed 2 months ago
Merge branch 'dev' into feat/windows-xdna-shared-expert-lane
c2357fa Kenneth-Javier Ortigoza committed 2 months ago
Merge pull request #1512 from JustVugg/fix/prof-microsecond-resolution
edd4f48 Vincenzo Fornaro committed 2 months ago
Merge pull request #1424 from kreuzzelg/qwen38-cuda-tier
2546d6a Vincenzo Fornaro committed 2 months ago
Merge pull request #1503 from JustVugg/fix/run-snap-non-glm
333e760 Vincenzo Fornaro committed 2 months ago
tests: make the GPU test suite build and pass under HIP on gfx1151
97cd762 huppiflupp committed 2 months ago
Merge pull request #1507 from JustVugg/docs/mtp-check-and-qwen36-hip
9b4eb1a Vincenzo Fornaro committed 2 months ago
Merge pull request #1506 from JustVugg/feat/olmoe-prof-phases
a572518 Vincenzo Fornaro committed 2 months ago
Merge pull request #1483 from kevin9327/fix/serve-context-exceeded
ef011dc Vincenzo Fornaro committed 2 months ago
Merge pull request #1484 from kevin9327/fix/rans-tools-utf8-stdout
82ee2ce Vincenzo Fornaro committed 2 months ago
Merge pull request #1489 from kevin9327/fix/coli-bench-non-glm
6cea190 Vincenzo Fornaro committed 2 months ago
Merge pull request #1508 from JustVugg/docs/gpu-datapoint-quality-check
cc292e2 Vincenzo Fornaro committed 2 months ago
Merge pull request #1495 from EricSpencer00/sparse-routing-dev
4bc6c56 Vincenzo Fornaro committed 2 months ago
Merge pull request #1505 from JustVugg/fix/hip-s4-wmma-gate
068e729 Vincenzo Fornaro committed 2 months ago
Merge pull request #1504 from JustVugg/fix/olmoe-mem-available
35eabcc Vincenzo Fornaro committed 2 months ago
Merge pull request #1294 from ZacharyZcR/docs/867-benchmarking-protocol
94d46c0 Vincenzo Fornaro committed 2 months ago
Merge pull request #1455 from trigger2k20/feat/glm53-mirror-io
1812ba6 Vincenzo Fornaro committed 2 months ago
Merge pull request #1470 from trigger2k20/docs/glm53-metal-cap-sweep
18cbd57 Vincenzo Fornaro committed 2 months ago
Merge pull request #1469 from trigger2k20/test/glm53-metal-check
ca772f5 Vincenzo Fornaro committed 2 months ago
Merge pull request #1466 from trigger2k20/chore/glm53-english-diagnostics
537ea29 Vincenzo Fornaro committed 2 months ago
docs(benchmarks): a GPU-backend datapoint needs a correctness line
f4be684 JustVugg committed 2 months ago
docs: the MTP head check accepts the single-file container; qwen36 HIP build line
0946eb2 JustVugg committed 2 months ago
olmoe: PROF measures matmul, attention, lm_head and forwards
b3be32f JustVugg committed 2 months ago
gpu: gate grouped_s4_wmma on the s4 fragment type and sm_75, not on WMMA
19af0fc JustVugg committed 2 months ago
coli run: hand every engine its model directory through SNAP
ea84603 JustVugg committed 2 months ago
feat(api): opt-in prompt-injected tool translation for OLMoE and Qwen3.6
073dc4d basil-k-aji-dev committed 2 months ago