Qwen3.8-Flash-Next on any consumer hardware: one-click install for Windows / Linux. Strata inference engine, OpenAI/Anthropic API on localhost, optional image input.
C++
Commits on main
App: French for the four new DeepSeek card and 12 GB NVIDIA strings (fx80-fx83)
59b4be2 Niko1221 committed 24 days ago
Merge f-027-dscard: the DeepSeek card names the free disk the set needs (owner-approved wording)
98e3598 Niko1221 committed 24 days ago
Prefill: opt-in STRATA_DEQUANT_SIDE=1 dequantizes the dense weights on a side stream into a double-buffered scratch (#3779, #3712)
dc390c3 linxuhao committed 24 days ago
Merge f-027-app2: master switches in the app and Terminal settings
03d7098 Niko1221 committed 24 days ago
mmvq_il: the sm_89 (Ada) decode tables are on by default on compute capability 8.9 only, STRATA_MMVQ_IL_89=0 and STRATA_DEFAULTS=026 turn them off (#3453)
663ec80 Niko1221 committed 24 days ago
Merge f-027-int2 into f-027-gh-eng (brings STRATA_DEFAULTS=026 and the other 0.2.7 integration work)
46a9cd8 Niko1221 committed 24 days ago
Merge f-027-i18n: French as the ninth app language and the Polish README
52ba0b7 Niko1221 committed 24 days ago
Merge f-027-gh-eng-k1 (#3867 #3751 #3453 #3943 #3820 #3752 #3455: Pascal and sm_89 opt-in kernel ports)
551f1cd Niko1221 committed 24 days ago
iq_kernels: GP100 4-bit gate/up expert slots, opt-in STRATA_EXPERT_NIBBLE=1 (#3455)
9067cc6 ruibeikaa committed 24 days ago
prefill: a resident layer's experts weight-stationary on GP100, opt-in STRATA_MMQ_WS=1 (#3752)
5dbd877 ruibeikaa committed 24 days ago
Split serving: docs pointers, check tool puts session files in /dev/shm
60e6a06 Niko1221 committed 24 days ago
Native head: opt-in STRATA_EMBED_VRAM=1 keeps the token-embedding table in VRAM (#3779, #3712)
884e37d linxuhao committed 24 days ago
Prefill: opt-in STRATA_PLE_COPY_STREAM=1 uploads the compact PLE rows on their own stream (#3779, #3712)
d6428bf linxuhao committed 24 days ago
Prefill PLE: opt-in STRATA_PLE_COMPACT=1 uploads the raw IQ4_NL rows and dequantizes them on the device (#3779, #3712)
17b08c9 linxuhao committed 24 days ago
prefill: mmq::swiglu_quant, swiglu and the down product's q8_1 rows in one kernel (#3752)
dd97421 sergiywith committed 24 days ago
Prefill fused IQ experts: opt-in 256-thread kernels STRATA_PF_FUSED_NT=256 and whole-layer launches STRATA_PF_BATCH=N (#3779, #3712)
bdcc34d linxuhao committed 24 days ago
tests: lm_kernels_parity checks the two kernels of the layer-major prompt path (#3976)
945a63b Niko1221 committed 24 days ago
Dense dequant: the wide kernels by default on sm_80 too, bitwise (#3779, #3712)
269c6d3 linxuhao committed 24 days ago
Merge f-027-gh-eng-g (#3935 sm_89 in the DeepSeek CUDA package builds, #3796 collapsed tool-name alias and the rejected-calls marker)
40c9dae Niko1221 committed 24 days ago
serve: a call returned as text for an undeclared name is named in the reply; the collapsed mcp__a__b spelling is the declared tool (#3796)
805ebe1 Niko1221 committed 24 days ago
qsa_select: multi-CTA decode top-k and a shuffle-free decode scorer, opt-in STRATA_SELECT_LONG=1 (#3820)
b434a8a ruibeikaa committed 24 days ago
Web page: German and dark screenshots in tools/webtest/shots.mjs
40e7836 Niko1221 committed 24 days ago
Web page: the chat view in eight languages, and the page's docs
4661596 Niko1221 committed 24 days ago