Qwen3.8-Flash-Next on any consumer hardware: one-click install for Windows / Linux. Strata inference engine, OpenAI/Anthropic API on localhost, optional image input.
C++
Commits on main
Merge f-0243-gui into f-0243-rel (Chat.tsx and DropZone.tsx: the guifix clipboard helpers kept at the conflicts, copyAndTell stays for Markdown and Serving)
061a285 Niko1221 committed 26 days ago
DeepSeek Metal: batched q8 quantiser, zero-copy expert mapping (DS4_ZC), spin-wait, GPU-busy and timing switches
5dce2f6 Niko1221 committed 26 days ago
ds4_gg_bench: --k512 calls the AVX-512 rows (iq512x_rows) directly against ggml-cpu's dot, bit for bit, and says whether the CPU and type allow them
e752c65 Niko1221 committed 26 days ago
Merge f-026-5070 final chunk rule (7bf6e4d3b) into f-0243-rel
8b8f8a1 Niko1221 committed 26 days ago
DeepSeek Metal: chunk path mixes through the fused hc_mix kernel
c2675c6 Niko1221 committed 26 days ago
Merge f-026-5070 (prefill chunk default rule) into f-0243-rel
56ac21a Niko1221 committed 26 days ago
DeepSeek engine: 4096 chunk rule applies to a GGUF pack only when it is copied into RAM (--mmap-experts off) and to an explicit --tp 1 single card; the experts-read-in-place default stays 8192; other packs keep 2048
829913e Niko1221 committed 26 days ago
DeepSeek Metal: chunked prompt path correct (sgemm on the one Context, KEEP dump syncs, debug switches); 2988-token prompt 251-277 tok/s vs 32 in windows
700def6 Niko1221 committed 26 days ago
Tests never write the owner's real Strata profile: pytest gets scratch LOCALAPPDATA/XDG state and data folders; the host test runner and the native-control test files get a scratch settings file, components folder and app data
535cacb Niko1221 committed 26 days ago
Engine bundle cleanup: one function (cleanupAfterInstall) writes the removed and kept lines to the host output, with a test that both reach it
67a6ee7 Niko1221 committed 26 days ago
One size figure: engine sizes are decimal MB, rounded half up, in the Terminal (strata update) and the app; both tested on the same numbers
a264168 Niko1221 committed 26 days ago
DeepSeek engine: gfx11 WMMA expert kernels for the prompt sets, on by default on gfx1151 (Strix Halo: prompts +22..29% at the same KL), opt-in on other gfx11 parts; STRATA_DS4_HIPK=0 turns them off
e6c5997 Niko1221 committed 26 days ago
Sizes in decimal MB on the first-run card and the update check (one helper); the engine bundle of a per-GPU install is removed after an update only when the same engine is complete in the store (size and SHA-256), else kept with one log line
7063f3a Niko1221 committed 26 days ago
DeepSeek Metal: chunked prompt path (MPP expert tile GEMMs, dense gemm/dq, rows_f16), NC-column matvecs, dangling buffer and null-arg offset fixes (WIP, chunk output not yet matching window path)
58e5d78 Niko1221 committed 26 days ago
CPU lane IQ1_M AVX-512 rows: the 64-weight step's scale words by one vpermw and the delta signs by a masked subtract (bit-identical to ggml's dot: 0 of 2.7M rows differ at 1 and 2 tokens on Zen 4 and Sapphire Rapids); +9% on the rows, the 1-token policy is unchanged
06f313b Niko1221 committed 26 days ago
Settings update check: a failed check of the app itself says so in one plain line, with the raw error behind Details (it used to show only Control's new-version text)
236e13b Niko1221 committed 26 days ago
App update: an update job an older host left running is finished when the installer has written uninstall.exe or changed the program file after the job began (the installer keeps the build time as the modified time)
c893eee Niko1221 committed 26 days ago
launch: the Speed choice and --experts need a DeepSeek engine of 0.1.50 or newer (0.1.49.2 does not accept the flag): an older or unknown engine gets no flag, no Speed step and no plan line, and no error; the version comes from the package folder, else --version; tests
9b4092a Niko1221 committed 26 days ago
DeepSeek Speed: offered and passed only when the installed DeepSeek engine is 0.1.50 or newer (an older one ends the start with unknown option --experts)
3283d2a Niko1221 committed 26 days ago
test: the own-GGUF check loads its helper by path (another tests package can already be loaded in a full tools run)
b79d693 Niko1221 committed 26 days ago
tests: the app-owned settings list includes the DeepSeek Speed choice
883e21b Niko1221 committed 26 days ago