Run frontier MoE models on hardware you already own — pure C, zero deps, experts streamed from disk. Tiny engine, immense model. 🐦
C
Commits on main
gateway: TCP_NODELAY set in setup, where macOS's refusal is a hangup
b899518 JustVugg committed 1 month ago
tests: the coli decision test needs laya_tiny's weights and the engine
541117e JustVugg committed 1 month ago
Merge System One (one decision API, /v1/brio removed) into GLiNER2.5-Decide
dce7a9f JustVugg committed 1 month ago
Merge dev (the OLMoE, Inkling, MiMo and GLM chains) into the Kimi K3 chain
f4ff18d JustVugg committed 1 month ago
tests: Kimi K3's dense chain on Lavapipe, and under ASan and UBSan
1b712da JustVugg committed 1 month ago
Merge remote-tracking branch 'origin/dev' into feat/decide-engines
d4343ff JustVugg committed 1 month ago
security(deepseek_v41): keep engram lookups inside their table
6216dce Marcello Costagliola committed 1 month ago
security(glm53): refuse matrices whose shape differs from the config
48b8ee2 Marcello Costagliola committed 1 month ago
Merge pull request #1850 from JustVugg/fix/setup-igpu-measured
55866f5 Vincenzo Fornaro committed 1 month ago
tests: deepseek_v41's dense chain on Lavapipe, and under ASan and UBSan
e865f36 JustVugg committed 1 month ago
Merge remote-tracking branch 'origin/dev' into feat/decide-engines
4376732 JustVugg committed 1 month ago
Makefile: the dn_gpu test links the Vulkan tier object like every other link that includes qwen36.c
aaefaf9 kreuzzelg committed 1 month ago
qwen36: null the DeltaNet flag arrays where the segment engine drops the state; one log line in English
a4e90a6 kreuzzelg committed 1 month ago
backend: the gated-delta reduction and memset go through the HIP shims
b7ead91 kreuzzelg committed 1 month ago
docs(qwen36): the layer split is speed-weighted; Ollama's one-card number for the record
31b8723 kreuzzelg committed 1 month ago
qwen36 tier: QT_HOME=layer weighs the split by each card's dense GEMV speed
9133011 kreuzzelg committed 1 month ago
docs(qwen36): shexp on request, the pipeline measured with the shared expert on the CPU
123497b kreuzzelg committed 1 month ago
qwen36: offer the shared expert to the placer on request only (Q36_OFFER_SHEXP=1)
006c540 kreuzzelg committed 1 month ago
docs(qwen36): QT_HOME=layer, the pipeline measured against the index split
6aca38b kreuzzelg committed 1 month ago
qwen36 tier: QT_HOME=layer, expert homes per layer range -- two cards as a pipeline
14336c6 kreuzzelg committed 1 month ago
docs(qwen36): the DeltaNet layer on the card, experts=all, the split counts model layers
1115564 kreuzzelg committed 1 month ago
qwen36 tier: dnout follows its layer's dnproj under auto; COLI_PLACE experts=all
764a7b9 kreuzzelg committed 1 month ago