Run frontier MoE models on hardware you already own β pure C, zero deps, experts streamed from disk. Tiny engine, immense model. π¦
C
Commits on main
docs: add GLM-5.2 experiment report on 4x RTX A6000 (Ampere) + EPYC 7402P
e982047 ThefloorMiner committed 3 months ago
docs: `coli serve` carries the dashboard too, and says so for headless hosts
af737e4 Mario Gutierrez committed 3 months ago
docs: `coli serve` carries the dashboard too, and says so for headless hosts
e064837 Mario Gutierrez committed 3 months ago
Merge pull request #754 from terrizoaguimor/feat/olmoe-route-trace
fe308c9 Vincenzo Fornaro committed 3 months ago
Merge pull request #756 from rgbkrk/docs-inkling-audio
bec1546 Vincenzo Fornaro committed 3 months ago
Merge pull request #755 from anrasi/fix/makefile-linux-aarch64
b6f4dfc Vincenzo Fornaro committed 3 months ago
docs: inkling audio input, including the 10 MB sidecar fetch
46da5ce Kyle Kelley committed 3 months ago
build: Linux/aarch64 branch in the Makefile β probe DOTPROD/I8MM, don't trust native (#631)
4705448 andres-gb10 committed 3 months ago
olmoe: adopt route_trace.h β the last engine on the shared history
8e13a0c Mario Gutierrez committed 3 months ago
olmoe: adopt route_trace.h β the last engine on the shared history
ba5c44a Mario Gutierrez committed 3 months ago
Merge pull request #752 from JustVugg/docs/plain-language-191
ee0c668 Vincenzo Fornaro committed 3 months ago
docs: plain language for the words that stopped three engineers (#191)
b41282a JustVugg committed 3 months ago
Merge pull request #749 from JustVugg/fix/serve-binary-mode-windows
113bc0f Vincenzo Fornaro committed 3 months ago
fix(win): put stdout in binary mode before the serve handshake (#748)
d14e292 JustVugg committed 3 months ago