Run frontier MoE models on hardware you already own β pure C, zero deps, experts streamed from disk. Tiny engine, immense model. π¦
C
Commits on main
Merge pull request #314 from mohamedmastouri2000-boop/fix/windows-cuda-dll-build
2dca36a Vincenzo committed 4 months ago
Merge pull request #322 from woolcoxm/fix/oracle-transformers-pin
b04c2ca Vincenzo committed 4 months ago
Merge pull request #320 from Magnet-js/docs/winget-python-readme
c686f6b Vincenzo committed 4 months ago
Merge pull request #318 from tt1203/fix/oracle-mkdir-glm-tiny
95b059b Vincenzo committed 4 months ago
docs/media: refreshed dashboard shots (full-residency 4 tok/s, disk 0), new Atlas galaxy, phone + sidebar shots
7bc9f6e ZacharyZcR committed 4 months ago
olmoe: PPL=1 teacher-forced perplexity mode (loss meter for throughput experiments)
c5f2027 Peter Groom committed 4 months ago
Merge branch 'main' into fix/windows-cuda-dll-build
c70d943 mohamedmastouri2000-boop committed 4 months ago
oracle: hard-fail on transformers < 5.11.0 (interleaved-RoPE floor, #281)
fa821a1 woolcoxm committed 4 months ago
Don't trust a converted checkpoint's config for the stop set
6de32c5 JustVugg committed 4 months ago
tests: extend the fmt=4 oracle to the fused gate+up kernel (#298)
ac7103f JustVugg committed 4 months ago
README: restructure around the technical path β parameters and full results move to docs/, four new figures
6429123 ZacharyZcR committed 4 months ago
docs: add winget python one-liner to Windows install block (#310)
05f9bd4 Elias committed 4 months ago
fix(prefetch): address fourth round of copilot review comments
c769e04 Egon Ruiter committed 4 months ago
fix(oracle): create glm_tiny/ before saving so a fresh checkout works
a3e9425 tt1203 committed 4 months ago
fix(prefetch): address third round of copilot review comments
b6bae91 Egon Ruiter committed 4 months ago
fix(prefetch): address second round of copilot review comments
2d8d295 Egon Ruiter committed 4 months ago
docs: serve protocol reference β mux wire format, telemetry lines, HTTP surface (#310)
deafa72 ZacharyZcR committed 4 months ago
Profiling: fix the phase accounting so 'Other' stops swallowing the disk stall
36394bc Claude committed 4 months ago
Profiling page: per-turn phase timings, live in the web dashboard
6afffbc Claude committed 4 months ago
PROF=1: per-request reports in mux serve mode too (the web-dashboard path)
63a6824 Claude committed 4 months ago
PROF=1: opt-in performance profile (latency percentiles, expert I/O, tuning verdict)
09bf17f Claude committed 4 months ago
fix(prefetch): address copilot code quality reviews on safety and concurrency
1ac2e7b Egon Ruiter committed 4 months ago
glm: COLI_NUMA=1 interleaves resident weights across NUMA nodes β +13% decode on 2S, raw mbind, no libnuma (#82)
2b182ae ZacharyZcR committed 4 months ago