Run frontier MoE models on hardware you already own — pure C, zero deps, experts streamed from disk. Tiny engine, immense model. 🐦
C
Commits on main
Merge pull request #420 from JustVugg/p417-metal-lfru
8f33bd1 Vincenzo Fornaro committed 4 months ago
metal: advance the LFRU recency clock on the GPU-prerouted decode path (#417)
cfcc742 JustVugg committed 4 months ago
Merge pull request #415 from JustVugg/docs-quickstart
ebc851e Vincenzo Fornaro committed 4 months ago
nix: python3 is only needed for checks, not for the actual build
40a3596 Attila Oláh committed 4 months ago
docs: beginner-friendly Quick Start guide for Linux/Windows/macOS (#414)
845af63 JustVugg committed 4 months ago
Merge pull request #413 from JustVugg/p-sec-trustboundary
3ffe4bb Vincenzo Fornaro committed 4 months ago
security: reject malformed model tensors at the untrusted-mirror boundary
72e3677 JustVugg committed 4 months ago
Merge pull request #412 from JustVugg/p396-packaging
fae4b2c Vincenzo Fornaro committed 4 months ago
packaging: single version source + honest editable-install semantics (on top of #396)
ca39e53 JustVugg committed 4 months ago
release: fix the Windows job shell — 'msys2 {0}', not 'msys2' (+ inherit PATH for 7z)
3cd2674 JustVugg committed 4 months ago
Merge pull request #410 from JustVugg/p403-rss-guard
e25aeec Vincenzo Fornaro committed 4 months ago
Merge pull request #408 from JustVugg/p401-tools-e2e
2f8fefd Vincenzo Fornaro committed 4 months ago
glm: measured-RSS guard — the RAM budget enforces itself at the safe point (#403)
c90e2cc JustVugg committed 4 months ago
test: skip the tools e2e suite on Windows (shebang mock engine)
0f606bc JustVugg committed 4 months ago
serve: end-to-end tool-calling regression test + unparsed-marker diagnosis (#401)
2122c00 JustVugg committed 4 months ago
Merge pull request #352 from woolcoxm/fix/test-stops-windows
d94c681 JustVugg committed 4 months ago