Qwen3.8-Flash-Next on any consumer hardware: one-click install for Windows / Linux. Strata inference engine, OpenAI/Anthropic API on localhost, optional image input.
C++
docs: the Strix Halo 8-bit hyper-connection line goes into a new release-notes-0.2.3.md (0.2.2 is released)
Niko1221e7ded666be1d
diff --git a/docs/release-notes-0.2.2.md b/docs/release-notes-0.2.2.mdindex 90ca53d21..9486736b4 100644--- a/docs/release-notes-0.2.2.md+++ b/docs/release-notes-0.2.2.md@@ -22,7 +22,6 @@- **The Linux CUDA 12 engine package has Pascal and Volta code again (#3503).** The 0.2.1 package was built for sm_75, 86 and 89 only because the repo held no recipe for it. `packaging/build_cuda_linux.sh` builds it for sm_60, 61, 70, 75, 80, 86 and 89, the packager refuses a CUDA 12 package without sm_60, 61 and 70, and the source Dockerfile takes `CUDA_IMAGE` and `CUDA_ARCHITECTURES`. A package built with it ran an IQ2_XS model on a Tesla P100. The 0.2.2 packages are built with it.- **HIP queue priming stands aside on a restricted queue count (#3480).** When `GPU_MAX_HW_QUEUES` is 1 or 2, the engine no longer opens its two priming queues and says so in one line (`STRATA_HIP_QUEUE_PRIME=nn` still forces them). It compiles for gfx1201; it was not measured on a gfx12 card.- **Docker.** An old (0.1.x) volume with `/data/models`, `/data/packs` and `/data/mtp` is moved into `/data/Strata-data` by rename instead of being downloaded and packed again (it used to start a 75 GB download). A card without `--gpus` stops at once with the `--gpus all` hint instead of after minutes of setup. A missing or empty `MODEL_PATH` gets a plain message. Settings that name another image's component folder (a CUDA 12 image on a CUDA 13 volume) are made again, and an engine folder renamed by an update no longer ends in `server_exited` when pictures are on. The terminal stage of the image build no longer needs git (it failed with `FileNotFoundError`); the commit comes in as a build argument, and all five image flavors built. Tested on one RTX 3060 PC with CUDA 12 and CUDA 13 images; no AMD or Intel image and no Docker Desktop.-- **Strix Halo decodes about 9% faster.** The hyper-connection weights are read as 8-bit (Q8_0) on gfx1151 by default: 5 interleaved pairs on IQ3_S gave +7.9% to +10.7% on JSON, code, tool calls, chat and an agent transcript. Answers are not bit-identical: they can differ in near-tie tokens, about as much as the engine's own CPU-versus-GPU expert rounding does (the numbers are in docs/AMD_HIP.md). `STRATA_HC_Q8=0` restores the old read.- **Re-runs do not tune again.** A tuning that found the standard settings already fastest counted as "not tuned", so `strata launch`, the TUI and the Docker entrypoint measured again at every start (20 minutes); it counts as tuned now. In the Terminal a first launch of an installed model took 521 s and the second 13 s on the test PC.- **Problems with the computer's own setup are repaired or explained, not refused.** If the Windows runtime folder lists another account, Strata locks it down itself instead of stopping. A Documents folder that cannot be used (Controlled folder access, an offline OneDrive) falls back to the Strata home folder and Settings > Storage says so. A port that is taken or reserved gets one sentence with the next step. Local requests ignore a system proxy. File-in-use errors and a full disk say what happened. `strata launch` asks plain questions in a terminal that reports a tty late. `strata update` copes with a slow `--version`, a busy graphics card is not held against an engine, pre-release Control builds hand over correctly, and a wrong PC clock is named as the reason a feed or certificate looks bad. install.sh and install.ps1 give clearer messages (ARM, TLS 1.2, proxy credentials, no `tar.exe`). The Terminal parts are already in 0.2.1.3; the Documents fallback and the port handling are app parts.- **A stale update notice goes away.** After a version change the app and the Terminal no longer keep showing an offer for a version you already have.diff --git a/docs/release-notes-0.2.3.md b/docs/release-notes-0.2.3.mdnew file mode 100644index 000000000..df5b50b47--- /dev/null+++ b/docs/release-notes-0.2.3.md@@ -0,0 +1,5 @@+# 0.2.3++## What is new++- **Strix Halo decodes about 9% faster.** The hyper-connection weights are read as 8-bit (Q8_0) on gfx1151 by default: 5 interleaved pairs on IQ3_S gave +7.9% to +10.7% on JSON, code, tool calls, chat and an agent transcript. Answers are not bit-identical: they can differ in near-tie tokens, about as much as the engine's own CPU-versus-GPU expert rounding does (the numbers are in docs/AMD_HIP.md). `STRATA_HC_Q8=0` restores the old read.