Skip to content

Qwen3.8-Flash-Next on any consumer hardware: one-click install for Windows / Linux. Strata inference engine, OpenAI/Anthropic API on localhost, optional image input.

C++

docs: the agent scenario - two conversations nearly double throughput

Niko122111b5a77fe999
diff --git a/docs/release-notes-0.2.7.md b/docs/release-notes-0.2.7.md
index 76289d720..0a044dfb3 100644
--- a/docs/release-notes-0.2.7.md
+++ b/docs/release-notes-0.2.7.md
@@ -54,7 +54,9 @@ on the RTX 3060 12 GB (IQ3_XXS), five interleaved pairs of fresh engines:
| prompt 4K, in a 4K context | 248.5 | **291.0 (+17.1%)** |
| decode behind a 4K document | 45.1 | **62.2 (+37.9%)** |
-It holds where it matters most: with **two conversations in flight** it measures **+67% aggregate** (59.7 against 35.6 tok/s),
+It holds where it matters most: with **two conversations in flight** the whole recipe reads **31.2 -> 62.0 tok/s aggregate
+(+99%)** and both answers arrive in 4.8 s instead of 9.7 s, and the routing default alone is **+67% aggregate** (59.7 against
+35.6 tok/s) -
and on content the tuning was never fitted to it **+29.0%** (43.5 -> 55.0 tok/s on a
document prompt), and the whole recipe - routing, a workload-fitted expert profile, `--adapt-every 0`, `--vram-reserve-mib
896` and the English draft vocabulary - gives **+26.5%** there and **+80%** on code in a sustained 80-request session.