Run frontier MoE models on hardware you already own — pure C, zero deps, experts streamed from disk. Tiny engine, immense model. 🐦
C
Commits on main
docs(qwen36 tier): Ollama reference row for the placement calibration
181d722 kreuzzelg committed 2 months ago
docs(qwen36 tier): Quadro and two-card calibration, the two-card caveat
371d35d kreuzzelg committed 2 months ago
qwen36 tier: qt_stats names the trunk share; docs: placement section with the first calibration
046dec6 kreuzzelg committed 2 months ago
feat(qwen36): automatic placement of the dense trunk (COLI_PLACE=auto)
ff13134 kreuzzelg committed 2 months ago
R4 Schritt 2: DeltaNet-Projektionen auf GPU, Platzierung konfigurierbar
85c90c4 kreuzzelg committed 2 months ago
R4 prototype: lm_head as resident int8 GPU tensor (COLI_LMHEAD_GPU)
868852a kreuzzelg committed 3 months ago
test(qwen36): the multidev tier test waits for the uploader to settle
bdeb338 kreuzzelg committed 2 months ago
test(qwen36): tier invariants on the fake backend, and the reservation leak they found
93c981b kreuzzelg committed 2 months ago
Merge pull request #1372 from JustVugg/release/1.10.2
d0f1791 Vincenzo Fornaro committed 2 months ago
release notes: KV slots (#1283) and image_url hardening (#1354)
f36e3f6 JustVugg committed 2 months ago
Merge remote-tracking branch 'origin/dev' into release/1.10.2
4d4ee4a JustVugg committed 2 months ago
Merge pull request #1354 from dmoraesrs/fix/security-hardening-dev
9e8eb14 Vincenzo Fornaro committed 2 months ago
Merge pull request #1283 from donovan-yohan/fix/glm53-kv-slots
09c1561 Vincenzo Fornaro committed 2 months ago
release notes: tier fixes (#1344) and the Windows launcher doc (#1291)
4adeee6 JustVugg committed 2 months ago
Merge remote-tracking branch 'origin/dev' into release/1.10.2
c93fa4f JustVugg committed 2 months ago
Merge pull request #1291 from ZacharyZcR/fix/1281-windows-release
b443c51 Vincenzo Fornaro committed 2 months ago
Merge pull request #1344 from crichalchemist/qwen36-tier-fixes
e950536 Vincenzo Fornaro committed 2 months ago
Merge pull request #1371 from JustVugg/feat/deepseek-reap-documented
68beda4 Vincenzo Fornaro committed 2 months ago
test(qwen36): bound the shutdown test with a thread, not SIGALRM
fa8142d JustVugg committed 2 months ago
docs+banner: DeepSeek V4 Flash REAP-150B is supported, and is not 284B
1ac934b JustVugg committed 2 months ago
Merge pull request #1369 from JustVugg/fix/convert-routes-by-family
6d92751 Vincenzo Fornaro committed 2 months ago
fix(convert): detect written options from argparse, not from argv
0a2c807 JustVugg committed 2 months ago
fix(convert): pick the converter from the checkpoint (#1368)
d4d11ef JustVugg committed 2 months ago
build(release): ship check_ablate_evidence.py beside the harness it verifies
ba2802a monotophic committed 2 months ago
Merge pull request #1367 from JustVugg/fix/glm-name-covers-53
6176c5b Vincenzo Fornaro committed 2 months ago