Qwen3.8-Flash-Next on any consumer hardware: one-click install for Windows / Linux. Strata inference engine, OpenAI/Anthropic API on localhost, optional image input.
C++
Regenerate launch previews after the model-list change
Niko1221982f43dee5ee
diff --git a/docs/terminal-previews/launch-monitor-connect-hermes.txt b/docs/terminal-previews/launch-monitor-connect-hermes.txtindex 2806209f4..d9ab6e5a4 100644--- a/docs/terminal-previews/launch-monitor-connect-hermes.txt+++ b/docs/terminal-previews/launch-monitor-connect-hermes.txt@@ -3,19 +3,19 @@STRATA Connect http://127.0.0.1:8080 [LIVE]1 Overview 2 Serving 3 Requests 4 Engine 5 Hardware 6 Logs [7 Connect]- ────────────────────────────────────────────────────────────────────────────────────────────────────- Connect an app URL http://127.0.0.1:8080/v1 model qwen3.8-flash-next-iq3_xxs key sk-strata-•••• (k show)+ ----------------------------------------------------------------------------------------------------+ Connect an app URL http://127.0.0.1:8080/v1 model qwen3.8-flash-next-iq3_xxs key sk-strata-**** (k show)also reachable at http://192.168.88.21:8080/v1App Works with Status- OpenCode chat + tools tested ✓- Codex CLI responses + tools tested ✓- Claude Code messages + tools tested ✓- oh-my-pi (omp) chat + tools tested ✓- pi (pi.dev) chat + tools tested ✓- › Hermes Agent chat + tools tested ✓- OpenClaw chat + tools tested ✓- DeepSeek Harness the Strata app tested ✓+ OpenCode chat + tools tested ok+ Codex CLI responses + tools tested ok+ Claude Code messages + tools tested ok+ oh-my-pi (omp) chat + tools tested ok+ pi (pi.dev) chat + tools tested ok+ > Hermes Agent chat + tools tested ok+ OpenClaw chat + tools tested ok+ DeepSeek Harness the Strata app tested okHermes Agent setup ~/.hermes/config.yamlmodel:diff --git a/docs/terminal-previews/launch-monitor-connect-opencode.txt b/docs/terminal-previews/launch-monitor-connect-opencode.txtindex 40ea89379..d6135ddd1 100644--- a/docs/terminal-previews/launch-monitor-connect-opencode.txt+++ b/docs/terminal-previews/launch-monitor-connect-opencode.txt@@ -3,19 +3,19 @@STRATA Connect http://127.0.0.1:8080 [LIVE]1 Overview 2 Serving 3 Requests 4 Engine 5 Hardware 6 Logs [7 Connect]- ────────────────────────────────────────────────────────────────────────────────────────────────────- Connect an app URL http://127.0.0.1:8080/v1 model qwen3.8-flash-next-iq3_xxs key sk-strata-•••• (k show)+ ----------------------------------------------------------------------------------------------------+ Connect an app URL http://127.0.0.1:8080/v1 model qwen3.8-flash-next-iq3_xxs key sk-strata-**** (k show)also reachable at http://192.168.88.21:8080/v1App Works with Status- › OpenCode chat + tools tested ✓- Codex CLI responses + tools tested ✓- Claude Code messages + tools tested ✓- oh-my-pi (omp) chat + tools tested ✓- pi (pi.dev) chat + tools tested ✓- Hermes Agent chat + tools tested ✓- OpenClaw chat + tools tested ✓- DeepSeek Harness the Strata app tested ✓+ > OpenCode chat + tools tested ok+ Codex CLI responses + tools tested ok+ Claude Code messages + tools tested ok+ oh-my-pi (omp) chat + tools tested ok+ pi (pi.dev) chat + tools tested ok+ Hermes Agent chat + tools tested ok+ OpenClaw chat + tools tested ok+ DeepSeek Harness the Strata app tested okOpenCode setup ~/.config/opencode/opencode.json{diff --git a/docs/terminal-previews/launch-monitor-overview.txt b/docs/terminal-previews/launch-monitor-overview.txtindex 1eb105e03..ecf18c946 100644--- a/docs/terminal-previews/launch-monitor-overview.txt+++ b/docs/terminal-previews/launch-monitor-overview.txt@@ -1,28 +1,28 @@# strata launch preview: the monitor's new Overview (view 1)# (text of the screen as drawn at the size named in tests/terminal/launch_previews.py)- STRATA Serving http://127.0.0.1:8095 IQ3_S 128K ● Reading prompt · 97% [LIVE]+ STRATA Serving http://127.0.0.1:8095 IQ3_S 128K * Reading prompt · 97% [LIVE][1 Overview] 2 Serving 3 Requests 4 Engine 5 Hardware 6 Logs 7 Connect- ──────────────────────────────────────────────────────────────────────────────────────────────────────────────+ --------------------------------------------------------------------------------------------------------------Model state Idle [Reading] Generating Queued Error 35,610 / 36,742 tokens · 97%- █████████████████████████████████████████████████████████████████████████████████████████████████████████░░░+ #########################################################################################################...- ╭─ Speed ────────────────╮ ╭─ GPU load ─────────────╮ ╭─ VRAM ─────────────────╮ ╭─ GPU temp ─────────────╮- │ 820.0 tok/s │ │ 88 % │ │ 11.2 / 12 GB │ │ 54 °C │+ ┌─ Speed ────────────────┐ ┌─ GPU load ─────────────┐ ┌─ VRAM ─────────────────┐ ┌─ GPU temp ─────────────┐+ │ 820.0 tok/s │ │ 88 % │ │ 11.2 / 12 GB │ │ 54 C ││ reading the prompt │ │ RTX 5070 │ │ 1,644 experts cached │ │ │- │ ▂▆▁▄█▂▆▁▄█▂▆▁▄█▂▆▁▄█▂▆ │ │ ▇▇▇▇█▇▇▇▇█▇▇▇▇█▇▇▇▇█▇▇ │ │ ██████████████████████ │ │ ▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄ │- ╰────────────────────────╯ ╰────────────────────────╯ ╰────────────────────────╯ ╰────────────────────────╯- ╭─ Power ────────────────╮ ╭─ PCIe ─────────────────╮ ╭─ CPU ──────────────────╮ ╭─ Disk read ────────────╮+ │ :*.=@:*.=@:*.=@:*.=@:* │ │ ####@####@####@####@## │ │ @@@@@@@@@@@@@@@@@@@@@@ │ │ ====================== │+ └────────────────────────┘ └────────────────────────┘ └────────────────────────┘ └────────────────────────┘+ ┌─ Power ────────────────┐ ┌─ PCIe ─────────────────┐ ┌─ CPU ──────────────────┐ ┌─ Disk read ────────────┐│ 114 W │ │ Gen4 x16 │ │ 14 % │ │ 0.1 MB/s ││ of 250 W limit │ │ to GPU 18,237 MB/s │ │ 6 cores · 12 threads │ │ write 0.0 MB/s │- │ ██████████████████████ │ │ ▆█▅▇█▆█▅▇█▆█▅▇█▆█▅▇█▆█ │ │ ▁▂▁▂▂▁▂▁▂▂▁▂▁▂▂▁▂▁▂▂▁▂ │ │ ▂▆▁▄█▂▆▁▄█▂▆▁▄█▂▆▁▄█▂▆ │- ╰────────────────────────╯ ╰────────────────────────╯ ╰────────────────────────╯ ╰────────────────────────╯+ │ @@@@@@@@@@@@@@@@@@@@@@ │ │ *@+#@*@+#@*@+#@*@+#@*@ │ │ .:.::.:.::.:.::.:.::.: │ │ :*.=@:*.=@:*.=@:*.=@:* │+ └────────────────────────┘ └────────────────────────┘ └────────────────────────┘ └────────────────────────┘Context fill 36K / 128K 28% Recent requests- ████████████░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░ TIME STATUS PROMPT REUSED OUTPUT TOK/S DURATION- Experts in VRAM 1,644 · 3.2 GB 02:14:56 Done 17,183 0 19,511 50.5 429.8 s- ██████████████░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░ 02:14:52 Done 626 0 11 26.8 4.0 s+ ############................................ TIME STATUS PROMPT REUSED OUTPUT TOK/S DURATION+ Experts in VRAM 1,644 · 3.2 GB 05:09:13 Done 17,183 0 19,511 50.5 429.8 s+ ##############.............................. 05:09:09 Done 626 0 11 26.8 4.0 sSystem RAM 58.5 / 63 GB- █████████████████████████████████████████░░░+ #########################################...1-7 views / filter Space freeze r refresh t theme b open in browser ? help q quit@@ -36,4 +36,4 @@- Read only | q detaches without stopping Strata+ Read only | q asks: keep serving or stop | 7 connect an appdiff --git a/docs/terminal-previews/launch-overview-ascii.txt b/docs/terminal-previews/launch-overview-ascii.txtindex effe95495..f747b1b3b 100644--- a/docs/terminal-previews/launch-overview-ascii.txt+++ b/docs/terminal-previews/launch-overview-ascii.txt@@ -18,8 +18,8 @@ Model state Idle Reading [Generating] Queued Error└────────────────────────┘ └────────────────────────┘ └────────────────────────┘ └────────────────────────┘Context fill 36K / 128K 28% Recent requests############................................ TIME STATUS PROMPT REUSED OUTPUT TOK/S DURATION-Experts in VRAM 1,644 · 3.2 GB 02:14:58 Done 17,183 0 19,511 50.5 429.8 s-##############.............................. 02:14:54 Done 626 0 11 26.8 4.0 s+Experts in VRAM 1,644 · 3.2 GB 05:09:15 Done 17,183 0 19,511 50.5 429.8 s+##############.............................. 05:09:11 Done 626 0 11 26.8 4.0 sSystem RAM 58.5 / 63 GB#########################################...diff --git a/docs/terminal-previews/launch-start.txt b/docs/terminal-previews/launch-start.txtindex 2b48a3af6..8597c8893 100644--- a/docs/terminal-previews/launch-start.txt+++ b/docs/terminal-previews/launch-start.txt@@ -1,7 +1,7 @@# strata launch preview: start screen with saved presets# (text of the screen as drawn at the size named in tests/terminal/launch_previews.py)- STRATA Launch RTX 5070 12 GB · 64 GB RAM · 93 GB free+ STRATA Launch RTX 5070 12 GB · 64 GB RAM · 94 GB free────────────────────────────────────────────────────────────────────────────────────────────────────────────Start from a saved preset@@ -31,6 +31,6 @@────────────────────────────────────────────────────────────────────────────────────────────────────────────- This computer: RTX 5070 12 GB · 64 GB RAM · 93 GB free. Preset: model, context, parallel requests, tuned+ This computer: RTX 5070 12 GB · 64 GB RAM · 94 GB free. Preset: model, context, parallel requests, tunedsettings, access. Shared with the Strata app.↑↓ choose Enter launch e edit preset d delete ? help q quitdiff --git a/docs/terminal-previews/launch-step1-model.txt b/docs/terminal-previews/launch-step1-model.txtindex ada5cc2ad..aff17f440 100644--- a/docs/terminal-previews/launch-step1-model.txt+++ b/docs/terminal-previews/launch-step1-model.txt@@ -3,26 +3,26 @@STRATA Set up Step 1 of 9: Model────────────────────────────────────────────────────────────────────────────────────────────────────────────- Which model? This computer: RTX 5070 12 GB · 64 GB RAM · 93 GB free- Model Download Needs (graphics + RAM) On this computer- Qwen3.8-Flash-Next Q2_0 66 GB 12 GB + 27 GB fits- Qwen3.8-Flash-Next IQ2_XS 68 GB 12 GB + 28 GB fits- › Qwen3.8-Flash-Next IQ3_XXS 76 GB 12 GB + 36 GB fits (recommended)- Qwen3.8-Flash-Next IQ3_S 84 GB 12 GB + 43 GB fits- Swift 1.5 IQ2_XS 68 GB 12 GB + 28 GB fits- Swift 1.5 IQ3_XXS 76 GB 12 GB + 36 GB fits- Swift 1.5 IQ3_S 84 GB 12 GB + 43 GB fits- Qwen3.8-Flash-Next Coder IQ1_M 58 GB 12 GB + 16 GB fits- Qwen3.8-Flash-Next (Unsloth) UD-IQ4_XS 94 GB 12 GB + 52 GB fits, part read from SSD- Qwen3.8-Flash-Next (Unsloth) UD-Q4_K_XL 111 GB 12 GB + 54 GB fits, part read from SSD- Qwen3.8-Flash-Next (Unsloth) UD-Q5_K_XL 158 GB 12 GB + 54 GB tight: much read from SSD- Qwen3.8-Flash-Next (Unsloth) UD-Q6_K_XL 169 GB 12 GB + 54 GB tight: much read from SSD- Qwen3.8-Flash-Next (Unsloth) Q8_0 188 GB 12 GB + 54 GB tight: much read from SSD- Qwen3.8-Flash-Next (Gyro) Gyro-S 58 GB 12 GB + 20 GB fits- Qwen3.8-Flash-Next (Gyro) Gyro-M 92 GB 12 GB + 27 GB fits- Qwen3.8-Flash-Next (NVFP4) NVFP4 128 GB 12 GB + 54 GB does not fit (can still try)- Qwen3.8-Flash-Next (NVFP4) NVFP4-NVIDIA 128 GB 12 GB + 54 GB does not fit (can still try)- Qwen3.8-Flash-Next (NVFP4) NVFP4-QAD 102 GB 12 GB + 54 GB does not fit (can still try)+ Which model? This computer: RTX 5070 12 GB · 64 GB RAM · 94 GB free+ Model Download Needs (RAM + VRAM) On this computer+ Qwen3.8-Flash-Next Q2_0 66 GB 35 GB fits+ Qwen3.8-Flash-Next IQ2_XS 68 GB 36 GB fits+ › Qwen3.8-Flash-Next IQ3_XXS 76 GB 44 GB fits (recommended)+ Qwen3.8-Flash-Next IQ3_S 84 GB 51 GB fits+ Swift 1.5 IQ2_XS 68 GB 36 GB fits+ Swift 1.5 IQ3_XXS 76 GB 44 GB fits+ Swift 1.5 IQ3_S 84 GB 51 GB fits+ Qwen3.8-Flash-Next Coder IQ1_M 58 GB 24 GB fits+ Qwen3.8-Flash-Next (Unsloth) UD-IQ4_XS 94 GB 60 GB fits, part read from SSD+ Qwen3.8-Flash-Next (Unsloth) UD-Q4_K_XL 111 GB 78 GB fits · uses SSD 16 GB+ Qwen3.8-Flash-Next (Unsloth) UD-Q5_K_XL 158 GB 99 GB tight · uses SSD 37 GB+ Qwen3.8-Flash-Next (Unsloth) UD-Q6_K_XL 169 GB 110 GB tight · uses SSD 48 GB+ Qwen3.8-Flash-Next (Unsloth) Q8_0 188 GB 129 GB tight · uses SSD 67 GB+ Qwen3.8-Flash-Next (Gyro) Gyro-S 58 GB 28 GB fits+ Qwen3.8-Flash-Next (Gyro) Gyro-M 92 GB 35 GB fits+ Qwen3.8-Flash-Next (NVFP4) NVFP4 128 GB 69 GB does not fit (can still try) · use+ Qwen3.8-Flash-Next (NVFP4) NVFP4-NVIDIA 128 GB 69 GB does not fit (can still try) · use+ Qwen3.8-Flash-Next (NVFP4) NVFP4-QAD 102 GB 69 GB does not fit (can still try) · usediff --git a/docs/terminal-previews/launch-step2-folder.txt b/docs/terminal-previews/launch-step2-folder.txtindex 34183488a..fba6e3e04 100644--- a/docs/terminal-previews/launch-step2-folder.txt+++ b/docs/terminal-previews/launch-step2-folder.txt@@ -5,7 +5,7 @@────────────────────────────────────────────────────────────────────────────────────────────────────────────Where should the model files be stored?Needs about 84 GB (the download plus working room).- Free space in that folder's drive: 93 GB+ Free space in that folder's drive: 94 GB┌──────────────────────────────────────────────────────────────────────────────────────────────────────────┐│ C:\Users\AI-Server\Documents\Strata │└──────────────────────────────────────────────────────────────────────────────────────────────────────────┘diff --git a/docs/terminal-previews/launch-step7-advanced.txt b/docs/terminal-previews/launch-step7-advanced.txtindex 29c64c474..79cbe68a9 100644--- a/docs/terminal-previews/launch-step7-advanced.txt+++ b/docs/terminal-previews/launch-step7-advanced.txt@@ -4,15 +4,15 @@STRATA Set up Step 7 of 9: Advanced────────────────────────────────────────────────────────────────────────────────────────────────────────────All settings (optional · for tinkerers) / filter x show experimental only- Setting Default Tuned Yours What it does- › --expert-cache auto auto - experts kept in graphics memory- --kv int8 int8 - how the conversation memory is stored- --max-context 131072 131072 - memory for the conversation- --prefill auto auto - how many prompt tokens are read at on- --spec 4 4 - draft tokens per step- --native-rope - - - [experimental] experimental pinned ro- STRATA_PIN_BY_NEED off off - Pin memory only when needed- + Add a setting by name… for flags of newer engine versions+ Setting Default Tuned Yours What it does+ › --expert-cache auto auto - experts kept in graphics memory+ --kv int8 int8 - how the conversation memory is stored+ --max-context 131072 131072 - memory for the conversation+ --prefill auto auto - how many prompt tokens are read at once+ --spec 4 4 - draft tokens per step+ --native-rope - - - [experimental] experimental pinned rotary arithm+ STRATA_PIN_BY_NEED off off - Pin memory only when needed+ + Add a setting by name… for flags of newer engine versionsCommand that will runcomponent:strata-engine --max-context 131072 --kv int8 --prefill auto --expert-cache auto --spec 4Same as: strata launch --model iq3_xxs --context 128k --vision off --tune quick --access local --port 8080diff --git a/docs/terminal-previews/launch-step8-access.txt b/docs/terminal-previews/launch-step8-access.txtindex 5d324baa5..bda825f88 100644--- a/docs/terminal-previews/launch-step8-access.txt+++ b/docs/terminal-previews/launch-step8-access.txt@@ -29,9 +29,9 @@--────────────────────────────────────────────────────────────────────────────────────────────────────────────+ Windows may ask whether to allow Strata (python.exe) on your network: choose Allow for private networks. If+ you choose Cancel, the model still works on this computer.Other computers on your network can use it at the address shown. Keep the API key on.↑↓ choose Enter next p port k new key t key on/off Esc back ? helpAn API key was made for you, because this reaches beyond your computer.diff --git a/docs/terminal-previews/launch-twocards-start.txt b/docs/terminal-previews/launch-twocards-start.txtindex b984b5052..96b615efd 100644--- a/docs/terminal-previews/launch-twocards-start.txt+++ b/docs/terminal-previews/launch-twocards-start.txt@@ -1,7 +1,7 @@# strata launch preview: start screen with saved presets# (text of the screen as drawn at the size named in tests/terminal/launch_previews.py)- STRATA Launch NVIDIA RTX A4000 16 GB x2 · 64 GB RAM · 93 GB free+ STRATA Launch NVIDIA RTX A4000 16 GB x2 · 64 GB RAM · 94 GB free────────────────────────────────────────────────────────────────────────────────────────────────────────────Start from a saved preset@@ -31,6 +31,6 @@────────────────────────────────────────────────────────────────────────────────────────────────────────────- This computer: NVIDIA RTX A4000 16 GB x2 · 64 GB RAM · 93 GB free. Preset: model, context, parallel+ This computer: NVIDIA RTX A4000 16 GB x2 · 64 GB RAM · 94 GB free. Preset: model, context, parallelrequests, tuned settings, access. Shared with the Strata app.↑↓ choose Enter launch e edit preset d delete ? help q quit