Run frontier MoE models on hardware you already own — pure C, zero deps, experts streamed from disk. Tiny engine, immense model. 🐦
C
Commits on main
Merge pull request #878 from terrizoaguimor/fix/kimi-first-request-state
9d7cddd Vincenzo Fornaro committed 3 months ago
Merge pull request #877 from ZacharyZcR/fix/k3-vk-tier-fill
487b99c Vincenzo Fornaro committed 3 months ago
test: assert the launcher DISPATCHES every engine it ships, not just that it packages them
561a942 JustVugg committed 3 months ago
Merge pull request #849 from ZacharyZcR/fix/cuda-failure-not-permanent
2d14d6d Vincenzo Fornaro committed 3 months ago
Merge pull request #874 from ZacharyZcR/fix/gitignore-build-dir
aacf25d Vincenzo Fornaro committed 3 months ago
A CUDA fallback is a property of the call, not of the tensor
0830495 ZacharyZcR committed 3 months ago
Merge pull request #873 from JustVugg/docs/logo-tagline
cefe9e1 Vincenzo Fornaro committed 3 months ago
Merge pull request #819 from ZacharyZcR/feat/kimi-cuda-mxfp4
667c1cf Vincenzo Fornaro committed 3 months ago
Merge pull request #801 from ZacharyZcR/feat/sanitizer-ci
8076bbb Vincenzo Fornaro committed 3 months ago
Merge pull request #872 from JustVugg/fix/k3-ram-budget
69db498 Vincenzo Fornaro committed 3 months ago
Merge pull request #870 from waizuichougou/pr/deepseek-v4-bounded-rope
1eb8b0d Vincenzo Fornaro committed 3 months ago
Merge pull request #871 from JustVugg/fix/k3-web-open
aa46e7b Vincenzo Fornaro committed 3 months ago
web: open the dashboard when the engine is ready, however long that takes (#854)
4c35c21 JustVugg committed 3 months ago
Merge pull request #869 from JustVugg/fix/cap-mixed-width
0f4598b Vincenzo Fornaro committed 3 months ago
deepseek_v4: bound RoPE computation to requested positions
b5bd711 waizuichougou committed 3 months ago
Merge pull request #868 from JustVugg/fix/release-deepseek
f9e3890 Vincenzo Fornaro committed 3 months ago
plan: price each expert row at its own width, not the container's widest (#856)
7c97625 JustVugg committed 3 months ago
Merge pull request #862 from terrizoaguimor/fix/k3-repack-cumulative-index
c9e0211 Vincenzo Fornaro committed 3 months ago
Merge pull request #861 from terrizoaguimor/fix/anthropic-architecture-rendering
c6d860e Vincenzo Fornaro committed 3 months ago
Merge pull request #852 from dyKiU/bugfix/autotune-throughput-precision
ee7d761 Vincenzo Fornaro committed 3 months ago
Merge pull request #850 from ZacharyZcR/fix/sigterm-graceful-stop
f6a0260 Vincenzo Fornaro committed 3 months ago