Qwen3.8-Flash-Next on any consumer hardware: one-click install for Windows / Linux. Strata inference engine, OpenAI/Anthropic API on localhost, optional image input.
C++
docs/GYRO.md: Gyro-M was 24% slower than Q2_0 before 0.2.2 (the measured table says 24)
Niko12212c27afec08d0
diff --git a/docs/GYRO.md b/docs/GYRO.mdindex 453bc2a85..c42774844 100644--- a/docs/GYRO.md+++ b/docs/GYRO.md@@ -12,7 +12,7 @@ is anybody's default.| **Download** (the n-gram table is inside the file) | **58.5 GB** | **92.0 GB** || **Memory it needs** (VRAM + RAM together) | **27.6 GB** | **35 GB** || Experts (trellis) | TQK6 gate/up, TQK7 down | TQ2_T |-| In plain words | the smallest option, for PCs with little memory; lower quality than the 2-3-bit sizes | about IQ3_XXS quality with about 20% less GPU memory; decodes about 16% slower than Q2_0 on a 12 GB RTX 3060 (23% slower before engine 0.2.2) |+| In plain words | the smallest option, for PCs with little memory; lower quality than the 2-3-bit sizes | about IQ3_XXS quality with about 20% less GPU memory; decodes about 16% slower than Q2_0 on a 12 GB RTX 3060 (24% slower before engine 0.2.2) |About half of each file is the n-gram (PLE) table: it stays on the SSD and is read row by row for every token, so keepthe file on a fast local drive. The memory figure is what the weights take once loaded.