Run frontier MoE models on hardware you already own — pure C, zero deps, experts streamed from disk. Tiny engine, immense model. 🐦
C
Commits on main
Merge pull request #951 from gouravkargwal/docs/m3-olmoe-datapoint
517ec60 Vincenzo Fornaro committed 3 months ago
Merge pull request #981 from JustVugg/fix/cuda-test-fmt7
bb310d4 Vincenzo Fornaro committed 3 months ago
fix(doctor): keep the Windows linkage probe portable in tests
36378ea Kenneth-Javier Ortigoza committed 3 months ago
docs(plan): clarify Windows unified-memory discovery
dd6c22d Kenneth-Javier Ortigoza committed 3 months ago
fix(cli): exclude unqualified GPUs from auto-enable
9ffa28b Kenneth-Javier Ortigoza committed 3 months ago
fix(doctor): recognize the expected Windows GPU backend
ad8a75b Kenneth-Javier Ortigoza committed 3 months ago
feat(plan): discover Windows AMD GPUs via hipInfo
80370ed Kenneth-Javier Ortigoza committed 3 months ago
refactor(plan): isolate unqualified GPU discovery
b5a8bac Kenneth-Javier Ortigoza committed 3 months ago
fixup: lockstep pty harness — macOS libedit eats pre-written input
071e041 JustVugg committed 3 months ago
Merge pull request #948 from dcutugno/feat/v4-dsml-tool-calling
35a6037 Vincenzo Fornaro committed 3 months ago
test(cli): drive chat_attached under a pty against a fake SSE server
1850bd1 JustVugg committed 3 months ago
test(cuda): fmt=7 is real now — fix the stale negative case (#971)
d954ad4 JustVugg committed 3 months ago
fix(cli): stream the model's thinking in chat, dim and boxed (#979)
0eef2fc JustVugg committed 3 months ago
Merge pull request #976 from JustVugg/fix/v4-ngen-clamp
8d1d96a Vincenzo Fornaro committed 3 months ago
v4: max_tokens is a ceiling — clamp to context instead of rejecting (#975)
8c40fbd JustVugg committed 3 months ago
fix(test): update V4 tool render test for DSML tool support (#916)
6568305 dcutugno committed 3 months ago
fix(build): gate glibc compat header on __GLIBC__, not __linux__
360c57d martinm86867-ops committed 3 months ago
feat(v4): emit dashboard telemetry (EMAP/HITS/TIERS/PROF/HWINFO)
7b50437 martinm86867-ops committed 3 months ago
Merge pull request #968 from terrizoaguimor/fix/olmoe-temp-and-inflight
3147248 Vincenzo Fornaro committed 3 months ago
feat(v4): the expert history lives in route_trace.h now — #700 completed
fa3a86b Mario Gutiérrez committed 3 months ago
fix(olmoe): COLI_TEMP channel, and never evict an in-flight slot
3780c4e Mario Gutiérrez committed 3 months ago
fix(pilot): free the recency sentinel when a speculative load fails
afad8b7 Mario Gutiérrez committed 3 months ago