Skip to content

Qwen3.8-Flash-Next on any consumer hardware: one-click install for Windows / Linux. Strata inference engine, OpenAI/Anthropic API on localhost, optional image input.

C++

Regenerate launch previews after the model-list change

Niko1221982f43dee5ee
diff --git a/docs/terminal-previews/launch-monitor-connect-hermes.txt b/docs/terminal-previews/launch-monitor-connect-hermes.txt
index 2806209f4..d9ab6e5a4 100644
--- a/docs/terminal-previews/launch-monitor-connect-hermes.txt
+++ b/docs/terminal-previews/launch-monitor-connect-hermes.txt
@@ -3,19 +3,19 @@
STRATA Connect http://127.0.0.1:8080 [LIVE]
1 Overview 2 Serving 3 Requests 4 Engine 5 Hardware 6 Logs [7 Connect]
- ────────────────────────────────────────────────────────────────────────────────────────────────────
- Connect an app URL http://127.0.0.1:8080/v1 model qwen3.8-flash-next-iq3_xxs key sk-strata-•••• (k show)
+ ----------------------------------------------------------------------------------------------------
+ Connect an app URL http://127.0.0.1:8080/v1 model qwen3.8-flash-next-iq3_xxs key sk-strata-**** (k show)
also reachable at http://192.168.88.21:8080/v1
App Works with Status
- OpenCode chat + tools tested ✓
- Codex CLI responses + tools tested ✓
- Claude Code messages + tools tested ✓
- oh-my-pi (omp) chat + tools tested ✓
- pi (pi.dev) chat + tools tested ✓
- › Hermes Agent chat + tools tested ✓
- OpenClaw chat + tools tested ✓
- DeepSeek Harness the Strata app tested ✓
+ OpenCode chat + tools tested ok
+ Codex CLI responses + tools tested ok
+ Claude Code messages + tools tested ok
+ oh-my-pi (omp) chat + tools tested ok
+ pi (pi.dev) chat + tools tested ok
+ > Hermes Agent chat + tools tested ok
+ OpenClaw chat + tools tested ok
+ DeepSeek Harness the Strata app tested ok
Hermes Agent setup ~/.hermes/config.yaml
model:
diff --git a/docs/terminal-previews/launch-monitor-connect-opencode.txt b/docs/terminal-previews/launch-monitor-connect-opencode.txt
index 40ea89379..d6135ddd1 100644
--- a/docs/terminal-previews/launch-monitor-connect-opencode.txt
+++ b/docs/terminal-previews/launch-monitor-connect-opencode.txt
@@ -3,19 +3,19 @@
STRATA Connect http://127.0.0.1:8080 [LIVE]
1 Overview 2 Serving 3 Requests 4 Engine 5 Hardware 6 Logs [7 Connect]
- ────────────────────────────────────────────────────────────────────────────────────────────────────
- Connect an app URL http://127.0.0.1:8080/v1 model qwen3.8-flash-next-iq3_xxs key sk-strata-•••• (k show)
+ ----------------------------------------------------------------------------------------------------
+ Connect an app URL http://127.0.0.1:8080/v1 model qwen3.8-flash-next-iq3_xxs key sk-strata-**** (k show)
also reachable at http://192.168.88.21:8080/v1
App Works with Status
- › OpenCode chat + tools tested ✓
- Codex CLI responses + tools tested ✓
- Claude Code messages + tools tested ✓
- oh-my-pi (omp) chat + tools tested ✓
- pi (pi.dev) chat + tools tested ✓
- Hermes Agent chat + tools tested ✓
- OpenClaw chat + tools tested ✓
- DeepSeek Harness the Strata app tested ✓
+ > OpenCode chat + tools tested ok
+ Codex CLI responses + tools tested ok
+ Claude Code messages + tools tested ok
+ oh-my-pi (omp) chat + tools tested ok
+ pi (pi.dev) chat + tools tested ok
+ Hermes Agent chat + tools tested ok
+ OpenClaw chat + tools tested ok
+ DeepSeek Harness the Strata app tested ok
OpenCode setup ~/.config/opencode/opencode.json
{
diff --git a/docs/terminal-previews/launch-monitor-overview.txt b/docs/terminal-previews/launch-monitor-overview.txt
index 1eb105e03..ecf18c946 100644
--- a/docs/terminal-previews/launch-monitor-overview.txt
+++ b/docs/terminal-previews/launch-monitor-overview.txt
@@ -1,28 +1,28 @@
# strata launch preview: the monitor's new Overview (view 1)
# (text of the screen as drawn at the size named in tests/terminal/launch_previews.py)
- STRATA Serving http://127.0.0.1:8095 IQ3_S 128K ● Reading prompt · 97% [LIVE]
+ STRATA Serving http://127.0.0.1:8095 IQ3_S 128K * Reading prompt · 97% [LIVE]
[1 Overview] 2 Serving 3 Requests 4 Engine 5 Hardware 6 Logs 7 Connect
- ──────────────────────────────────────────────────────────────────────────────────────────────────────────────
+ --------------------------------------------------------------------------------------------------------------
Model state Idle [Reading] Generating Queued Error 35,610 / 36,742 tokens · 97%
- █████████████████████████████████████████████████████████████████████████████████████████████████████████░░░
+ #########################################################################################################...
- ╭─ Speed ────────────────╮ ╭─ GPU load ─────────────╮ ╭─ VRAM ─────────────────╮ ╭─ GPU temp ─────────────╮
- │ 820.0 tok/s │ │ 88 % │ │ 11.2 / 12 GB │ │ 54 °C │
+ ┌─ Speed ────────────────┐ ┌─ GPU load ─────────────┐ ┌─ VRAM ─────────────────┐ ┌─ GPU temp ─────────────┐
+ │ 820.0 tok/s │ │ 88 % │ │ 11.2 / 12 GB │ │ 54 C │
│ reading the prompt │ │ RTX 5070 │ │ 1,644 experts cached │ │ │
- │ ▂▆▁▄█▂▆▁▄█▂▆▁▄█▂▆▁▄█▂▆ │ │ ▇▇▇▇█▇▇▇▇█▇▇▇▇█▇▇▇▇█▇▇ │ │ ██████████████████████ │ │ ▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄ │
- ╰────────────────────────╯ ╰────────────────────────╯ ╰────────────────────────╯ ╰────────────────────────╯
- ╭─ Power ────────────────╮ ╭─ PCIe ─────────────────╮ ╭─ CPU ──────────────────╮ ╭─ Disk read ────────────╮
+ │ :*.=@:*.=@:*.=@:*.=@:* │ │ ####@####@####@####@## │ │ @@@@@@@@@@@@@@@@@@@@@@ │ │ ====================== │
+ └────────────────────────┘ └────────────────────────┘ └────────────────────────┘ └────────────────────────┘
+ ┌─ Power ────────────────┐ ┌─ PCIe ─────────────────┐ ┌─ CPU ──────────────────┐ ┌─ Disk read ────────────┐
│ 114 W │ │ Gen4 x16 │ │ 14 % │ │ 0.1 MB/s │
│ of 250 W limit │ │ to GPU 18,237 MB/s │ │ 6 cores · 12 threads │ │ write 0.0 MB/s │
- │ ██████████████████████ │ │ ▆█▅▇█▆█▅▇█▆█▅▇█▆█▅▇█▆█ │ │ ▁▂▁▂▂▁▂▁▂▂▁▂▁▂▂▁▂▁▂▂▁▂ │ │ ▂▆▁▄█▂▆▁▄█▂▆▁▄█▂▆▁▄█▂▆ │
- ╰────────────────────────╯ ╰────────────────────────╯ ╰────────────────────────╯ ╰────────────────────────╯
+ │ @@@@@@@@@@@@@@@@@@@@@@ │ │ *@+#@*@+#@*@+#@*@+#@*@ │ │ .:.::.:.::.:.::.:.::.: │ │ :*.=@:*.=@:*.=@:*.=@:* │
+ └────────────────────────┘ └────────────────────────┘ └────────────────────────┘ └────────────────────────┘
Context fill 36K / 128K 28% Recent requests
- ████████████░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░ TIME STATUS PROMPT REUSED OUTPUT TOK/S DURATION
- Experts in VRAM 1,644 · 3.2 GB 02:14:56 Done 17,183 0 19,511 50.5 429.8 s
- ██████████████░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░ 02:14:52 Done 626 0 11 26.8 4.0 s
+ ############................................ TIME STATUS PROMPT REUSED OUTPUT TOK/S DURATION
+ Experts in VRAM 1,644 · 3.2 GB 05:09:13 Done 17,183 0 19,511 50.5 429.8 s
+ ##############.............................. 05:09:09 Done 626 0 11 26.8 4.0 s
System RAM 58.5 / 63 GB
- █████████████████████████████████████████░░░
+ #########################################...
1-7 views / filter Space freeze r refresh t theme b open in browser ? help q quit
@@ -36,4 +36,4 @@
- Read only | q detaches without stopping Strata
+ Read only | q asks: keep serving or stop | 7 connect an app
diff --git a/docs/terminal-previews/launch-overview-ascii.txt b/docs/terminal-previews/launch-overview-ascii.txt
index effe95495..f747b1b3b 100644
--- a/docs/terminal-previews/launch-overview-ascii.txt
+++ b/docs/terminal-previews/launch-overview-ascii.txt
@@ -18,8 +18,8 @@ Model state Idle Reading [Generating] Queued Error
└────────────────────────┘ └────────────────────────┘ └────────────────────────┘ └────────────────────────┘
Context fill 36K / 128K 28% Recent requests
############................................ TIME STATUS PROMPT REUSED OUTPUT TOK/S DURATION
-Experts in VRAM 1,644 · 3.2 GB 02:14:58 Done 17,183 0 19,511 50.5 429.8 s
-##############.............................. 02:14:54 Done 626 0 11 26.8 4.0 s
+Experts in VRAM 1,644 · 3.2 GB 05:09:15 Done 17,183 0 19,511 50.5 429.8 s
+##############.............................. 05:09:11 Done 626 0 11 26.8 4.0 s
System RAM 58.5 / 63 GB
#########################################...
diff --git a/docs/terminal-previews/launch-start.txt b/docs/terminal-previews/launch-start.txt
index 2b48a3af6..8597c8893 100644
--- a/docs/terminal-previews/launch-start.txt
+++ b/docs/terminal-previews/launch-start.txt
@@ -1,7 +1,7 @@
# strata launch preview: start screen with saved presets
# (text of the screen as drawn at the size named in tests/terminal/launch_previews.py)
- STRATA Launch RTX 5070 12 GB · 64 GB RAM · 93 GB free
+ STRATA Launch RTX 5070 12 GB · 64 GB RAM · 94 GB free
────────────────────────────────────────────────────────────────────────────────────────────────────────────
Start from a saved preset
@@ -31,6 +31,6 @@
────────────────────────────────────────────────────────────────────────────────────────────────────────────
- This computer: RTX 5070 12 GB · 64 GB RAM · 93 GB free. Preset: model, context, parallel requests, tuned
+ This computer: RTX 5070 12 GB · 64 GB RAM · 94 GB free. Preset: model, context, parallel requests, tuned
settings, access. Shared with the Strata app.
↑↓ choose Enter launch e edit preset d delete ? help q quit
diff --git a/docs/terminal-previews/launch-step1-model.txt b/docs/terminal-previews/launch-step1-model.txt
index ada5cc2ad..aff17f440 100644
--- a/docs/terminal-previews/launch-step1-model.txt
+++ b/docs/terminal-previews/launch-step1-model.txt
@@ -3,26 +3,26 @@
STRATA Set up Step 1 of 9: Model
────────────────────────────────────────────────────────────────────────────────────────────────────────────
- Which model? This computer: RTX 5070 12 GB · 64 GB RAM · 93 GB free
- Model Download Needs (graphics + RAM) On this computer
- Qwen3.8-Flash-Next Q2_0 66 GB 12 GB + 27 GB fits
- Qwen3.8-Flash-Next IQ2_XS 68 GB 12 GB + 28 GB fits
- › Qwen3.8-Flash-Next IQ3_XXS 76 GB 12 GB + 36 GB fits (recommended)
- Qwen3.8-Flash-Next IQ3_S 84 GB 12 GB + 43 GB fits
- Swift 1.5 IQ2_XS 68 GB 12 GB + 28 GB fits
- Swift 1.5 IQ3_XXS 76 GB 12 GB + 36 GB fits
- Swift 1.5 IQ3_S 84 GB 12 GB + 43 GB fits
- Qwen3.8-Flash-Next Coder IQ1_M 58 GB 12 GB + 16 GB fits
- Qwen3.8-Flash-Next (Unsloth) UD-IQ4_XS 94 GB 12 GB + 52 GB fits, part read from SSD
- Qwen3.8-Flash-Next (Unsloth) UD-Q4_K_XL 111 GB 12 GB + 54 GB fits, part read from SSD
- Qwen3.8-Flash-Next (Unsloth) UD-Q5_K_XL 158 GB 12 GB + 54 GB tight: much read from SSD
- Qwen3.8-Flash-Next (Unsloth) UD-Q6_K_XL 169 GB 12 GB + 54 GB tight: much read from SSD
- Qwen3.8-Flash-Next (Unsloth) Q8_0 188 GB 12 GB + 54 GB tight: much read from SSD
- Qwen3.8-Flash-Next (Gyro) Gyro-S 58 GB 12 GB + 20 GB fits
- Qwen3.8-Flash-Next (Gyro) Gyro-M 92 GB 12 GB + 27 GB fits
- Qwen3.8-Flash-Next (NVFP4) NVFP4 128 GB 12 GB + 54 GB does not fit (can still try)
- Qwen3.8-Flash-Next (NVFP4) NVFP4-NVIDIA 128 GB 12 GB + 54 GB does not fit (can still try)
- Qwen3.8-Flash-Next (NVFP4) NVFP4-QAD 102 GB 12 GB + 54 GB does not fit (can still try)
+ Which model? This computer: RTX 5070 12 GB · 64 GB RAM · 94 GB free
+ Model Download Needs (RAM + VRAM) On this computer
+ Qwen3.8-Flash-Next Q2_0 66 GB 35 GB fits
+ Qwen3.8-Flash-Next IQ2_XS 68 GB 36 GB fits
+ › Qwen3.8-Flash-Next IQ3_XXS 76 GB 44 GB fits (recommended)
+ Qwen3.8-Flash-Next IQ3_S 84 GB 51 GB fits
+ Swift 1.5 IQ2_XS 68 GB 36 GB fits
+ Swift 1.5 IQ3_XXS 76 GB 44 GB fits
+ Swift 1.5 IQ3_S 84 GB 51 GB fits
+ Qwen3.8-Flash-Next Coder IQ1_M 58 GB 24 GB fits
+ Qwen3.8-Flash-Next (Unsloth) UD-IQ4_XS 94 GB 60 GB fits, part read from SSD
+ Qwen3.8-Flash-Next (Unsloth) UD-Q4_K_XL 111 GB 78 GB fits · uses SSD 16 GB
+ Qwen3.8-Flash-Next (Unsloth) UD-Q5_K_XL 158 GB 99 GB tight · uses SSD 37 GB
+ Qwen3.8-Flash-Next (Unsloth) UD-Q6_K_XL 169 GB 110 GB tight · uses SSD 48 GB
+ Qwen3.8-Flash-Next (Unsloth) Q8_0 188 GB 129 GB tight · uses SSD 67 GB
+ Qwen3.8-Flash-Next (Gyro) Gyro-S 58 GB 28 GB fits
+ Qwen3.8-Flash-Next (Gyro) Gyro-M 92 GB 35 GB fits
+ Qwen3.8-Flash-Next (NVFP4) NVFP4 128 GB 69 GB does not fit (can still try) · use
+ Qwen3.8-Flash-Next (NVFP4) NVFP4-NVIDIA 128 GB 69 GB does not fit (can still try) · use
+ Qwen3.8-Flash-Next (NVFP4) NVFP4-QAD 102 GB 69 GB does not fit (can still try) · use
diff --git a/docs/terminal-previews/launch-step2-folder.txt b/docs/terminal-previews/launch-step2-folder.txt
index 34183488a..fba6e3e04 100644
--- a/docs/terminal-previews/launch-step2-folder.txt
+++ b/docs/terminal-previews/launch-step2-folder.txt
@@ -5,7 +5,7 @@
────────────────────────────────────────────────────────────────────────────────────────────────────────────
Where should the model files be stored?
Needs about 84 GB (the download plus working room).
- Free space in that folder's drive: 93 GB
+ Free space in that folder's drive: 94 GB
┌──────────────────────────────────────────────────────────────────────────────────────────────────────────┐
│ C:\Users\AI-Server\Documents\Strata │
└──────────────────────────────────────────────────────────────────────────────────────────────────────────┘
diff --git a/docs/terminal-previews/launch-step7-advanced.txt b/docs/terminal-previews/launch-step7-advanced.txt
index 29c64c474..79cbe68a9 100644
--- a/docs/terminal-previews/launch-step7-advanced.txt
+++ b/docs/terminal-previews/launch-step7-advanced.txt
@@ -4,15 +4,15 @@
STRATA Set up Step 7 of 9: Advanced
────────────────────────────────────────────────────────────────────────────────────────────────────────────
All settings (optional · for tinkerers) / filter x show experimental only
- Setting Default Tuned Yours What it does
- › --expert-cache auto auto - experts kept in graphics memory
- --kv int8 int8 - how the conversation memory is stored
- --max-context 131072 131072 - memory for the conversation
- --prefill auto auto - how many prompt tokens are read at on
- --spec 4 4 - draft tokens per step
- --native-rope - - - [experimental] experimental pinned ro
- STRATA_PIN_BY_NEED off off - Pin memory only when needed
- + Add a setting by name… for flags of newer engine versions
+ Setting Default Tuned Yours What it does
+ › --expert-cache auto auto - experts kept in graphics memory
+ --kv int8 int8 - how the conversation memory is stored
+ --max-context 131072 131072 - memory for the conversation
+ --prefill auto auto - how many prompt tokens are read at once
+ --spec 4 4 - draft tokens per step
+ --native-rope - - - [experimental] experimental pinned rotary arithm
+ STRATA_PIN_BY_NEED off off - Pin memory only when needed
+ + Add a setting by name… for flags of newer engine versions
Command that will run
component:strata-engine --max-context 131072 --kv int8 --prefill auto --expert-cache auto --spec 4
Same as: strata launch --model iq3_xxs --context 128k --vision off --tune quick --access local --port 8080
diff --git a/docs/terminal-previews/launch-step8-access.txt b/docs/terminal-previews/launch-step8-access.txt
index 5d324baa5..bda825f88 100644
--- a/docs/terminal-previews/launch-step8-access.txt
+++ b/docs/terminal-previews/launch-step8-access.txt
@@ -29,9 +29,9 @@
-
-
────────────────────────────────────────────────────────────────────────────────────────────────────────────
+ Windows may ask whether to allow Strata (python.exe) on your network: choose Allow for private networks. If
+ you choose Cancel, the model still works on this computer.
Other computers on your network can use it at the address shown. Keep the API key on.
↑↓ choose Enter next p port k new key t key on/off Esc back ? help
An API key was made for you, because this reaches beyond your computer.
diff --git a/docs/terminal-previews/launch-twocards-start.txt b/docs/terminal-previews/launch-twocards-start.txt
index b984b5052..96b615efd 100644
--- a/docs/terminal-previews/launch-twocards-start.txt
+++ b/docs/terminal-previews/launch-twocards-start.txt
@@ -1,7 +1,7 @@
# strata launch preview: start screen with saved presets
# (text of the screen as drawn at the size named in tests/terminal/launch_previews.py)
- STRATA Launch NVIDIA RTX A4000 16 GB x2 · 64 GB RAM · 93 GB free
+ STRATA Launch NVIDIA RTX A4000 16 GB x2 · 64 GB RAM · 94 GB free
────────────────────────────────────────────────────────────────────────────────────────────────────────────
Start from a saved preset
@@ -31,6 +31,6 @@
────────────────────────────────────────────────────────────────────────────────────────────────────────────
- This computer: NVIDIA RTX A4000 16 GB x2 · 64 GB RAM · 93 GB free. Preset: model, context, parallel
+ This computer: NVIDIA RTX A4000 16 GB x2 · 64 GB RAM · 94 GB free. Preset: model, context, parallel
requests, tuned settings, access. Shared with the Strata app.
↑↓ choose Enter launch e edit preset d delete ? help q quit