Run frontier MoE models on hardware you already own β pure C, zero deps, experts streamed from disk. Tiny engine, immense model. π¦
C
Commits on main
Merge pull request #374 from ZacharyZcR/perf/p0-execution-profile
6ce6cc4 Vincenzo committed 4 months ago
Merge pull request #376 from KingIcyCreamProjects/docs/connect-coding-cli
d5dac9b Vincenzo committed 4 months ago
bench: multi-seed bench_dsa_select β kill single-input pivot-luck spike (#357)
153ee16 woolcoxm committed 4 months ago
docs(api): add "Connect a coding CLI or editor" recipe (#373)
73e0e5e KingIcyCreamProjects committed 4 months ago
glm: fmt=4 support in qt_addrow/qt_matvec_rows β CPU absorb path decoded grouped int4 as int2
946fcd4 bokiko committed 4 months ago
sampling: NaN-skip the mx scan too (review follow-up on #369)
e2d39ab KingIcyCreamProjects committed 4 months ago
sampling: guard against non-finite logits (was silent token-0 spew)
7f70a8d KingIcyCreamProjects committed 4 months ago
Merge remote-tracking branch 'upstream/dev' into feat/gpu-backend-hardening
92ddc22 noobdev-ph committed 4 months ago
merge: dev β keep engine-hip-syntax alongside the new windows-cuda-build job
755a9a4 noobdev-ph committed 4 months ago
Windows: fix non-ASCII chat prompt corruption (ANSI codepage vs UTF-8)
ef97f3c volognamor committed 4 months ago
Merge pull request #329 from mohamedmastouri2000-boop/docs/windows-native
19f2677 Vincenzo committed 4 months ago
Merge pull request #353 from woolcoxm/docs/environment-refresh-dev
d6d28f0 Vincenzo committed 4 months ago
Merge pull request #350 from woolcoxm/fix/build-warnings-dev
3d0a28b Vincenzo committed 4 months ago
Merge pull request #340 from tonuonu/fix/fs-detect-9p-statfs
59d74ae Vincenzo committed 4 months ago
Merge pull request #328 from mohamedmastouri2000-boop/fix/olmoe-ebits
1af9435 Vincenzo committed 4 months ago
Merge pull request #347 from ZacharyZcR/tools/e8-rate-scaled
1552db2 Vincenzo committed 4 months ago
win32: stop erasing the real ReadFile error β pread failures name their WinErr (#307)
211d448 JustVugg committed 4 months ago
sampling: partial top-keep select in attention_rows DSA β O(nk) quickselect, not O(nk log nk) qsort (#356)
5d16368 woolcoxm committed 4 months ago
bench: add bench_topp -- head-to-head old-qsort vs new-heap timing on V=151936 (#335)
37c96ee woolcoxm committed 4 months ago
sampling: partial top-p select in dist_build β O(V) heapify + k pops, not O(V log V) qsort (#335)
ba00889 woolcoxm committed 4 months ago