Run frontier MoE models on hardware you already own — pure C, zero deps, experts streamed from disk. Tiny engine, immense model. 🐦
C
Commits on main
feat(qwen38): image preprocessing, pinned against the official processor
9e422fe JustVugg committed 2 months ago
feat(qwen38): tool calling, and a tools flag that stops lying
1bcd5f2 JustVugg committed 2 months ago
Merge pull request #1250 from themorlock/feat/qwen38-flash-next
a29c6e6 Vincenzo Fornaro committed 2 months ago
Merge pull request #1271 from dawnfield-institute/upstream/qwen36-int4-unpack
8f44422 Vincenzo Fornaro committed 2 months ago
Merge branch 'dev' into feat/windows-xdna-shared-expert-lane
91733b8 Kenneth-Javier Ortigoza committed 2 months ago
Merge pull request #1232 from Petsku01/fix/qwen36-compiler-warnings-v2
e8628bc Vincenzo Fornaro committed 2 months ago
Merge branch 'dev' into fix/qwen36-compiler-warnings-v2
ec79720 Vincenzo Fornaro committed 2 months ago
Merge pull request #1277 from JustVugg/fix/pilot-worker-dangling-model
a9324aa Vincenzo Fornaro committed 2 months ago
fix(qwen36): heap overflow on a container whose two config files disagree
a5777a4 JustVugg committed 2 months ago
fix(clean): make clean actually remove qwen36 and glm53, and pin it
ea94318 JustVugg committed 2 months ago
fix(pilot): the prefetch worker outlives the Model it dereferences
ff5829c JustVugg committed 2 months ago
qwen36: vectorise the int4 expert unpack (2.10x CPU decode)
2e7dfa6 Peter Groom committed 2 months ago
Merge pull request #1270 from Unknown-Findout/fix/stripe-weighted
7892f58 Vincenzo Fornaro committed 2 months ago
test(loader): widen the ABI tripwire for the two new optional symbols
4967cde Unknown-Findout committed 2 months ago
fix(cuda): wire the two new symbols through the Windows DLL loader
7b4a236 Unknown-Findout committed 2 months ago
test(cuda): allocator footprint on real silicon, added to cuda-test
b3fe3e5 Unknown-Findout committed 2 months ago
fix(cuda): charge the expert tier real VRAM, not logical bytes (#687)
d9e0a67 Unknown-Findout committed 2 months ago
test(mirror): pin the stripe split, including that a slow leg gets a small share
313bb5f Unknown-Findout committed 2 months ago
fix(mirror): size stripe chunks by measured bandwidth, not 1/nsf
e7df0ac Unknown-Findout committed 2 months ago
Merge pull request #1269 from JustVugg/docs/absorb-hardware-datapoints
1049927 Vincenzo Fornaro committed 2 months ago
docs(benchmarks): absorb twelve community hardware datapoints
236a457 JustVugg committed 2 months ago
Merge pull request #1267 from JustVugg/fix/release-builds-glm53
2a12e44 Vincenzo Fornaro committed 2 months ago