Qwen3.8-Flash-Next on any consumer hardware: one-click install for Windows / Linux. Strata inference engine, OpenAI/Anthropic API on localhost, optional image input.
C++
Commits on main
launch: a real short tune for DeepSeek-V4.1-Flash (tools/dsv41/tune.py: the drafter on or off, CPU threads; gains over 5% only, written into the launch config; any failure leaves the standard settings with a plain line); the launch no longer forces --tune skip for it; tests
a2aeb4e Niko1221 committed 27 days ago
Terminal 0.2.4 / Control and engine 0.1.49: version bump for the DeepSeek V4.1-Flash release (app stays 0.2.3, Mac stays 0.1.48); release notes
8ea7fef Niko1221 committed 27 days ago
dsv41_fit: remove a duplicated constants block; one unit (tokens a second)
36a9485 Niko1221 committed 27 days ago
Merge f-dsv41-rel (0be62ccad) into v0.2.3.1: DeepSeek V4.1-Flash on top of the released 0.2.3 line
28ce98b Niko1221 committed 27 days ago
Merge f-dsv41-setup 86ba33845 into f-dsv41-rel (serve: DeepSeek turn without </think> returns its text as content; pack recipe noise token/markov rank; exec bits in packages; console-safe smoke)
0be62cc Niko1221 committed 27 days ago
serve: a DeepSeek turn that stops without </think> and wrote no answer returns its text as the answer (streaming ends with it as content; the non-streaming OpenAI and Anthropic replies drop the identical reasoning); tests
86ba338 Niko1221 committed 27 days ago
packaging: strata-dsv41 and strata-vision get execute bits in the package and in the tar (ELF header decides when packed on Windows); setup restores them on an engine copied without modes
6f507fb Niko1221 committed 27 days ago
setup: pack recipe states --dspark-noise-token 128799 and --dspark-markov-rank 256; plain wording (nothing to download, one unit: tokens a second, the one-time SHA-256 check and its time, the remembered-folder line)
1a7b4ae Niko1221 committed 27 days ago
setup: the smoke reply is made printable for the console code page before it is shown
a9dd554 Niko1221 committed 27 days ago
Merge f-dsv41-setup into f-dsv41-rel (setup installs the official IST-DAS 2.00/2.25 sets; strata-dsv41 in the engine packages)
3724818 Niko1221 committed 27 days ago
Merge f-dsv41-cpul e5f536a6c into f-dsv41-rel (AVX-512 one-token rows for Zen 4/5, bit-identical to ggml, per-type start-up self-check, chosen by the detected CPU)
e9546cb Niko1221 committed 27 days ago
dsv41 smoke: utf-8 output (the reply has DeepSeek's special tokens; a Windows console code page failed on them)
8de8d90 Niko1221 committed 27 days ago
dsv41 cpu lane: AVX-512 rows from 1 token on Zen 4 as well (IQ2_XXS, IQ2_XS; IQ3_XXS and IQ1_M from 2), measured
e5f536a Niko1221 committed 27 days ago
setup: DeepSeek family line names IST-DAS for the official 2-bit GGUFs and Unsloth for UD-Q8_K_XL; says who made the files of the chosen version
b6cc7e6 Niko1221 committed 27 days ago
setup test + docs: no --prefill-chunk, one plain line about the engine's own chunked prompt
f2323d8 Niko1221 committed 27 days ago
setup: drop --prefill-chunk (the chunked prompt is the engine's default now); doc line
10af5bb Niko1221 committed 27 days ago
Merge f-dsv41-r97 fb321d62c into f-dsv41-rel (layer-major chunked prompt as the engine default)
d6f18ba Niko1221 committed 27 days ago
dsv41 cpu lane: one-token AVX-512 rows - sign masks by popcount (IQ2_XXS, IQ2_XS, IQ3_XXS), IQ1_M AVX-512 rows with pdep indices; chosen per CPU (Zen 5 from 1 token)
1747c8e Niko1221 committed 27 days ago
dsv41: strata-dsv41 --version and a 'ds4: build <commit>' line with --verbose (commit from git at configure, a BUILD_ID file in an archive, or -DSTRATA_BUILD_ID)
f1cb66d Niko1221 committed 27 days ago
Merge f-dsv41-h100 (store pre-grow: register the whole arena before the first kernel on Linux, fixes the --ssd-cache zero-copy hang)
4eedb86 Niko1221 committed 27 days ago
setup: DeepSeek official sets start with --dspark-conf 0.65 (H100 measured default)
c506238 Niko1221 committed 27 days ago
dsv41: store arena pre-grown by default on Linux when the GPU maps it
c35710e Niko1221 committed 27 days ago
dsv41: the layer-major (chunked) prompt is the default on every run: chunks of 1024 for the single-card default run, staging ring 16 MB where the cards hold most of the experts
fb321d6 Niko1221 committed 27 days ago