Run frontier MoE models on hardware you already own — pure C, zero deps, experts streamed from disk. Tiny engine, immense model. 🐦
C
Commits on main
Fix Windows cuda-dll build: quote NVCC, gate MSVC warnings, add config stamp (#306)
9cf97a4 Mohamed Mastouri committed 4 months ago
refactor(prefetch): clean up unused variables, dead functions, and hardcoded paths
6ade409 Egon Ruiter committed 4 months ago
fix: set stdout to O_BINARY on Windows to prevent READY sentinel corruption
6728029 aleks committed 4 months ago
Merge pull request #308 from fermionoid/fix-metal-clang16-std
16b253a Vincenzo committed 4 months ago
Quarantine EXPERT_BUDGET: the operating window is measured empty (#303)
35f90b9 JustVugg committed 4 months ago
bench: survive transient hub errors — retry with backoff, per-task isolation, atomic writes (#304)
f86fc68 bokiko committed 4 months ago
Merge main into dev: Windows fixes (#275-279, #290) alongside engine work (#274, #293, #294, #297)
d4b4f33 JustVugg committed 4 months ago
Merge pull request #279 from KingIcyCreamProjects/pr/win32-launcher-defaults
3074c7d Vincenzo committed 4 months ago
Merge pull request #290 from NeuralNotwerk/fix/mlock-under-mmap
12d3bd5 Vincenzo committed 4 months ago
Merge pull request #278 from KingIcyCreamProjects/pr/win32-hwinfo
e8479da Vincenzo committed 4 months ago
Merge pull request #277 from KingIcyCreamProjects/pr/readme-mechanical-fixes
2f9ca31 Vincenzo committed 4 months ago
Merge pull request #276 from KingIcyCreamProjects/pr/bench-parser-fix
965e8a8 Vincenzo committed 4 months ago
Merge pull request #275 from KingIcyCreamProjects/pr/win32-physical-cores
1a83716 Vincenzo committed 4 months ago
Merge pull request #297 from RonitBStudent/fix/portable-target-architecture
c7531c4 Vincenzo committed 4 months ago
Merge pull request #293 from woolcoxm/fix/pipe2-profiling-and-cuda-mtp-optin
6d190d9 Vincenzo committed 4 months ago
Windows: pipe2 resident pipeline at decode + EXPERT_BUDGET ws_b cache fix (#274)
5f167e5 Vincenzo committed 4 months ago
glm: pin draft+verify to one kernel family during speculation; soften MTP guard (#163)
37da111 bokiko committed 4 months ago
cuda: fix pipe2 profile double-count + add COLI_CUDA_MTP opt-in (#292)
78c675e woolcoxm committed 4 months ago
glm: make MLOCK=1 actually wire pinned experts under COLI_MMAP
97fa526 NeuralNotwerk committed 4 months ago
glm(win): ignore cmd.exe's built-in PROMPT template; add COLI_PROMPT (#271)
550ddcb JustVugg committed 4 months ago
glm: bilingual (EN+IT) oracle-mismatch message, lead with English (#271)
6b4f5e5 JustVugg committed 4 months ago