Qwen3.8-Flash-Next on any consumer hardware: one-click install for Windows / Linux. Strata inference engine, OpenAI/Anthropic API on localhost, optional image input.
C++
Commits on main
metal: the 20k flush cap was the 256+ prompt failure; 4K now runs at 171 tok/s, and the launch histogram names the decode cost
0b2201c Niko1221 committed 27 days ago
metal: sparse attention + prompt matvec columns + exact wrap extents - prefill measured at 556 tok/s
c486f17 Niko1221 committed 27 days ago
launch: an installed DeepSeek model whose config names a gone engine, with no package in this install, is not 'already installed': setup runs (feed download, or one plain line with the next step) instead of the start failing on a missing file; tests
2ecdc2e Niko1221 committed 27 days ago
DeepSeek quality numbers from the final-tip scores (H100, 4,995 positions): 2.00 KL 0.170 ppl +15.5% (code +8.6%, agent +5.3%), 2.25 KL 0.107 ppl +7.3% (code +3.2%, agent +2.2%); README x7, DEEPSEEK41.md, release notes, setup and fit text
5353097 Niko1221 committed 27 days ago
launch: DeepSeek runs on this install's own engine package, not the exe path baked into an installed model's config (which can come from another Strata install on the computer or name a package folder an update replaced); tests
9011bd1 Niko1221 committed 27 days ago
IQ1_M quality from the H100 (KL 0.217, ppl 3.80, +21%; code +8.9%, agent +10.2%, weaker on plain prose) in setup, the fit text, README x7, DEEPSEEK41.md and the release notes
52b104b Niko1221 committed 27 days ago
launch: a reason joined after 'The engine could not be installed.' starts with a capital; test
00a2cfa Niko1221 committed 27 days ago
Merge f-024-maya2 (6c6267f33) into f-024-rel: Windows batch submit, flow pump, Stop during a long prompt, lane-free, opt-in switches (all in src/dsv41)
6eaf320 Niko1221 committed 27 days ago
dsv41: Maya-port defaults from the owner-PC A/Bs (ON: win_submit, flow pump, Stop, lane-free; OFF with switch: timer, Engram readers, unbuffered Engram, cold prefetch, DSpark cum)
6c6267f Niko1221 committed 27 days ago
launch: the Save screen shows DeepSeek's own tuning length (5-10 / 10-15 min) like the Tuning screen; walk test: save text, run paths, error paths
cec75af Niko1221 committed 27 days ago
tests: the 1.75 bpw set also runs with --tp 1 on 4 AMD cards; release notes: set up again on 4+ AMD cards
8ac2a83 Niko1221 committed 27 days ago
dsv41 iq test: IQ1_S set gate_up (f16) tolerance 1.5e-2 (data-order dependent, 7.1e-3..1.08e-2, same on the older build); fix a stale comment in ds4_model.cu (IQ1_S/IQ1_M/IQ4_NL have device kernels)
c4dcde7 Niko1221 committed 27 days ago
dsv41 plan: four or more AMD cards run the IST-DAS sets with --tp 1 (8K prompt 370 against 196 tokens a second on 4 x R9700)
67d5f44 Niko1221 committed 27 days ago
release notes: three sets everywhere, the DeepSeek engine is separate, Mac Control 0.1.49
6a35eb6 Niko1221 committed 27 days ago
Merge f-dsv41-tune (c5e0e1482) into f-024-rel: the third set IST-DAS 1.75 bpw (IQ1_M) in setup, fit and the launch list
12d0a4a Niko1221 committed 27 days ago
release notes: R9700 prompt numbers from the r97 command (4 cards 8K 505, 32K 818; kernels +36% / +49%)
9bb0034 Niko1221 committed 27 days ago
DeepSeek tables: the IQ1_M (1.75 bpw, ist-das-1.75bpw) row first, 239 GB; quality 'being measured' plus ISTA-DASLab's model-card figure; README + 6 translations, DEEPSEEK41.md, release notes (placeholder until the KL is in)
672612a Niko1221 committed 27 days ago
launch: a Runner that cannot be built is shown on the run screen as a plain failure instead of crashing the screens; tests: launch TUI walk (every screen, every key, Qwen and DeepSeek, 80x24 and wide, run paths, error paths)
267a2f4 Niko1221 committed 27 days ago
release notes: the prompt-skip agreement at the final tip, 99.5% of 799 positions
eec705c Niko1221 committed 27 days ago
metal: dispatches BATCH into one command buffer - decode 0.16 -> 48.7 tok/s (300x)
611530d Niko1221 committed 27 days ago
release notes: R9700 prompt numbers with the new kernels (4 cards 8K about 320, 32K about 750)
4f8770d Niko1221 committed 27 days ago