Run frontier MoE models on hardware you already own β pure C, zero deps, experts streamed from disk. Tiny engine, immense model. π¦
C
Commits on main
Merge pull request #957 from gouravkargwal/fix/omp-macos-tuning
34513cc Vincenzo Fornaro committed 3 months ago
Merge pull request #956 from gouravkargwal/fix/server-pre-first-frame-cancel
600c1a0 Vincenzo Fornaro committed 3 months ago
Merge pull request #960 from Blakeolson21/blake/inkling-windows-lock
58ac189 Vincenzo Fornaro committed 3 months ago
Merge pull request #961 from Blakeolson21/blake/coli-windows-venv-python
f158906 Vincenzo Fornaro committed 3 months ago
Merge pull request #962 from Blakeolson21/blake/convert-windows-positioned-write
1d21eaa Vincenzo Fornaro committed 3 months ago
fix(omp): skip the spin-wait tuning on macOS β measured slower (#707)
a20c7aa Gourav Kargwal committed 3 months ago
fix(api): cancel a generation that disconnects before the first frame (#908)
aa4c51a Gourav Kargwal committed 3 months ago
Merge remote-tracking branch 'upstream/dev' into ci/metal-test
279379d Gourav Kargwal committed 3 months ago
ci(metal): guard the macOS step against the paravirtual hang
1654f39 Gourav Kargwal committed 3 months ago
bench: decode-regime GEMV bandwidth vs the read ceiling, with a frozen A/B baseline
7e96e5a Mario Gutierrez committed 3 months ago
bench: decode-regime GEMV bandwidth vs the read ceiling, with a frozen A/B baseline
46cb37c Mario Gutierrez committed 3 months ago
fixup: keep Windows in the torch pin β +cpu wheels exist there too
f03bcea JustVugg committed 3 months ago
fixup: torch +cpu wheels are Linux-only β split the pin by platform
59e40e2 JustVugg committed 3 months ago
Merge pull request #944 from benmaster82/fix/glm-topk-bounds
54c970f Vincenzo Fornaro committed 3 months ago
fixup: the tiny oracle regenerates its fixture β give macOS the pinned deps
a169bec JustVugg committed 3 months ago
fixup: the Makefile.deepseek-v4 internal gate never got the Darwin arm
25bd8b7 JustVugg committed 3 months ago