Qwen3.8-Flash-Next on any consumer hardware: one-click install for Windows / Linux. Strata inference engine, OpenAI/Anthropic API on localhost, optional image input.
C++
Merge f-022-int into f-022-macgyro: Gyro is listed as supported on Intel Arc and on the Mac (docs, seven READMEs, release notes keep both bullets)
Niko122121b0fdb0d4ef
diff --cc README.de.mdindex 1bfd321d5,72eb048e4..61b665876--- a/README.de.md+++ b/README.de.md@@@ -164,7 -164,7 +164,7 @@@ Größen, mehr oder weniger stark kompr| **Gyro-S** | 27,6 GB | 58,5 GB | Für PCs, auf denen nichts anderes läuft. Die Qualität ist geringer als bei IQ2_XS. || **Gyro-M** | 35 GB | 92,0 GB | Ungefähr die Qualität von IQ3_XXS bei etwa 20 % weniger GPU-Speicher. Es schreibt Antworten auf einer 12-GB-Karte und auf einer R9700 17-21 % langsamer als Q2_0. |- Gyro läuft auf NVIDIA- und AMD-Karten (bei AMD experimentell), nicht auf Intel Arc und nicht auf dem Mac. Details und Messwerte:-Gyro läuft auf NVIDIA- und AMD-Karten (bei AMD experimentell) und auf Intel-Arc-Karten unter Linux (getestet auf einer Arc A750), nicht auf dem Mac. Details und Messwerte:++Gyro läuft auf NVIDIA- und AMD-Karten (bei AMD experimentell) auf Intel-Arc-Karten unter Linux (getestet auf einer Arc A750) und ab 0.2.2 auf Macs mit Apple Silicon (Gyro-S auf einem Mac mini mit 32 GB: 9 Tokens/s, die Experten werden von der SSD gelesen). Details und Messwerte:[docs/GYRO.md](docs/GYRO.md). Starte es mit `strata launch --model gyro-s`.### Die anderen Größendiff --cc README.es.mdindex 679fafd5a,0be4b744f..74c22cbb0--- a/README.es.md+++ b/README.es.md@@@ -164,7 -164,7 +164,7 @@@ comprimido. Los tamaños pequeños son| **Gyro-S** | 27,6 GB | 58,5 GB | Para PC donde no cabe nada más. La calidad es menor que la de IQ2_XS. || **Gyro-M** | 35 GB | 92,0 GB | Calidad parecida a IQ3_XXS con un 20 % menos de memoria de GPU. Escribe las respuestas un 17-21 % más despacio que Q2_0 en una tarjeta de 12 GB y en una R9700. |- Gyro funciona en tarjetas NVIDIA y AMD (en AMD es experimental), no en Intel Arc ni en el Mac. Detalles y mediciones:-Gyro funciona en tarjetas NVIDIA y AMD (en AMD es experimental) y en tarjetas Intel Arc con Linux (probado en una Arc A750), no en el Mac. Detalles y mediciones:++Gyro funciona en tarjetas NVIDIA y AMD (en AMD es experimental) en tarjetas Intel Arc con Linux (probado en una Arc A750) y, desde 0.2.2, en Mac con Apple Silicon (Gyro-S en un Mac mini de 32 GB: 9 tokens/s, con los expertos leídos del SSD). Detalles y mediciones:[docs/GYRO.md](docs/GYRO.md). Arráncalo con `strata launch --model gyro-s`.### Los demás tamañosdiff --cc README.fr.mdindex 9ce7d44e1,085648539..221fa7154--- a/README.fr.md+++ b/README.fr.md@@@ -165,7 -165,7 +165,7 @@@ plus ou moins compressé. Les petites t| **Gyro-S** | 27,6 Go | 58,5 Go | Pour les PC où rien d'autre ne tient. La qualité est inférieure à celle d'IQ2_XS. || **Gyro-M** | 35 Go | 92,0 Go | À peu près la qualité d'IQ3_XXS avec environ 20 % de mémoire GPU en moins. Il écrit les réponses 17 à 21 % plus lentement que Q2_0 sur une carte de 12 Go et sur une R9700. |- Gyro fonctionne sur les cartes NVIDIA et AMD (expérimental sur AMD), pas sur Intel Arc ni sur Mac. Détails et mesures :-Gyro fonctionne sur les cartes NVIDIA et AMD (expérimental sur AMD) et sur les cartes Intel Arc sous Linux (testé sur une Arc A750), pas sur Mac. Détails et mesures :++Gyro fonctionne sur les cartes NVIDIA et AMD (expérimental sur AMD) sur les cartes Intel Arc sous Linux (testé sur une Arc A750) et, depuis la 0.2.2, sur les Mac Apple Silicon (Gyro-S sur un Mac mini de 32 Go : 9 tokens/s, experts lus sur le SSD). Détails et mesures :[docs/GYRO.md](docs/GYRO.md). Lancez-le avec `strata launch --model gyro-s`.### Les autres taillesdiff --cc README.ja.mdindex e3d7e8353,8402120f0..f109026a9--- a/README.ja.md+++ b/README.ja.md@@@ -158,7 -158,7 +158,7 @@@ AI ツールは [MCP サーバー](docs| **Gyro-S** | 27.6 GB | 58.5 GB | ほかのサイズが入らないPC向け。品質は IQ2_XS より下がります。 || **Gyro-M** | 35 GB | 92.0 GB | 品質は IQ3_XXS 程度で、GPUメモリの使用量は約20%少なくなります。12 GBのカードと R9700 では、回答の書き出しが Q2_0 より17〜21%遅くなります。 |- Gyro は NVIDIA と AMD のカードで動きます(AMD は実験的)。Intel Arc と Mac では動きません。詳細と測定結果は-Gyro は NVIDIA と AMD のカード(AMD は実験的)、および Linux 上の Intel Arc カード(Arc A750 で確認)で動きます。Mac では動きません。詳細と測定結果は++Gyro は NVIDIA と AMD のカード(AMD は実験的)、および Linux 上の Intel Arc カード(Arc A750 で確認)で動きます。0.2.2 からは Apple Silicon の Mac でも動きます(32 GB の Mac mini で Gyro-S は 9 トークン/秒、エキスパートは SSD から読み込み)。詳細と測定結果は[docs/GYRO.md](docs/GYRO.md) にあります。`strata launch --model gyro-s` で起動します。### ほかのサイズdiff --cc README.mdindex e476898dc,394b1a3c6..d0afcab5a--- a/README.md+++ b/README.md@@@ -159,7 -159,7 +159,7 @@@ Smaller sizes are faster. Larger sizes| **Gyro-S** | 27.6 GB | 58.5 GB | For PCs that fit nothing else. Quality is lower than IQ2_XS. || **Gyro-M** | 35 GB | 92.0 GB | About IQ3_XXS quality with about 20% less GPU memory. It writes answers 17-21% slower than Q2_0 on a 12 GB card and on an R9700. |- Gyro runs on NVIDIA and AMD cards (AMD is experimental) and, from 0.2.2, on Apple Silicon Macs (Gyro-S on a 32 GB Mac mini: 9 tok/s, streaming from the SSD; [docs/MAC.md](docs/MAC.md#gyro-s-and-gyro-m-agentionais-trellis-experts)), not on Intel Arc. Details and measurements:-Gyro runs on NVIDIA and AMD cards (AMD is experimental) and on Intel Arc cards on Linux (tested on an Arc A750), not on the Mac. Details and measurements:++Gyro runs on NVIDIA and AMD cards (AMD is experimental) on Intel Arc cards on Linux (tested on an Arc A750) and, from 0.2.2, on Apple Silicon Macs (Gyro-S on a 32 GB Mac mini: 9 tok/s, streaming from the SSD; [docs/MAC.md](docs/MAC.md#gyro-s-and-gyro-m-agentionais-trellis-experts)). Details and measurements:[docs/GYRO.md](docs/GYRO.md). Start it with `strata launch --model gyro-s`.### The other sizesdiff --cc README.pt-BR.mdindex d97e534fb,9e34e5aa9..6cefc54e8--- a/README.pt-BR.md+++ b/README.pt-BR.md@@@ -158,7 -158,7 +158,7 @@@ O [Gyro](https://huggingface.co/agentio| **Gyro-S** | 27,6 GB | 58,5 GB | Para PCs onde nenhum outro tamanho cabe. A qualidade é menor que a do IQ2_XS. || **Gyro-M** | 35 GB | 92,0 GB | Qualidade próxima à do IQ3_XXS, com cerca de 20% menos memória da GPU. Ele escreve as respostas 17 a 21% mais devagar que o Q2_0 numa placa de 12 GB e numa R9700. |- O Gyro roda em placas NVIDIA e AMD (AMD é experimental), e não roda em Intel Arc nem no Mac. Detalhes e medições:-O Gyro roda em placas NVIDIA e AMD (AMD é experimental) e em placas Intel Arc no Linux (testado numa Arc A750), e não roda no Mac. Detalhes e medições:++O Gyro roda em placas NVIDIA e AMD (AMD é experimental) em placas Intel Arc no Linux (testado numa Arc A750) e, desde a 0.2.2, em Macs com Apple Silicon (Gyro-S num Mac mini de 32 GB: 9 tokens/s, com os especialistas lidos do SSD). Detalhes e medições:[docs/GYRO.md](docs/GYRO.md). Inicie com `strata launch --model gyro-s`.### Os outros tamanhosdiff --cc README.zh-CN.mdindex d16844858,72ec629d7..4238f249c--- a/README.zh-CN.md+++ b/README.zh-CN.md@@@ -157,7 -157,7 +157,7 @@@ Set up Strata on this PC for me: https:| **Gyro-S** | 27.6 GB | 58.5 GB | 给其他尺寸都放不下的电脑。质量低于 IQ2_XS。 || **Gyro-M** | 35 GB | 92.0 GB | 质量约相当于 IQ3_XXS,显存占用少约 20%。在 12 GB 显卡和 R9700 上,输出回答比 Q2_0 慢 17-21%。 |- Gyro 可在 NVIDIA 和 AMD 显卡上运行(AMD 为实验性支持),不支持 Intel Arc 和 Mac。详情和测试数据:-Gyro 可在 NVIDIA 和 AMD 显卡(AMD 为实验性支持)以及 Linux 上的 Intel Arc 显卡(已在 Arc A750 上测试)上运行,不支持 Mac。详情和测试数据:++Gyro 可在 NVIDIA 和 AMD 显卡(AMD 为实验性支持)以及 Linux 上的 Intel Arc 显卡(已在 Arc A750 上测试)上运行,自 0.2.2 起也可在 Apple Silicon 的 Mac 上运行(32 GB 的 Mac mini 上 Gyro-S 为 9 token/秒,专家权重从 SSD 读取)。详情和测试数据:[docs/GYRO.md](docs/GYRO.md)。用 `strata launch --model gyro-s` 启动。### 其他尺寸diff --cc docs/GYRO.mdindex b8d6aca58,61cc7dcf8..c7b3610d8--- a/docs/GYRO.md+++ b/docs/GYRO.md@@@ -37,9 -37,9 +37,9 @@@ the original model as for every Qwen3.8APR port, and the released 0.1.45 stops at v4. A ready-made engine that is older is replaced by one compiled from this source(setup), or the app says the model needs a newer engine and offers Update engine.- **Supported:** NVIDIA (CUDA, Linux and Windows), AMD (HIP, experimental: the authors validated gfx1151; we ran- gfx1201 with identical output to rc2) and Apple Silicon Macs (Metal, from 0.2.2: [On a Mac](#on-a-mac)). **Not supported:**- Intel Arc (SYCL): that engine has no trellis kernels.+ **Supported:** NVIDIA (CUDA, Linux and Windows) and AMD (HIP, experimental: the authors validated gfx1151; we ran-gfx1201 with identical output to rc2). **Intel Arc** (SYCL, Linux, built from source) runs both files: see [Intel Arc](#intel-arc-sycl). **Not supported:** Apple Metal: the engine there has no-trellis kernels and refuses the file at load with the reason.++gfx1201 with identical output to rc2). **Intel Arc** (SYCL, Linux, built from source) runs both files: see [Intel Arc](#intel-arc-sycl). **Apple Silicon Macs** (Metal) run both files from++0.2.2: see [On a Mac](#on-a-mac).**Pictures.** Gyro reads pictures with the original model's picture reader file (the same one every Qwen3.8-Flash-Nextmodel uses; setup downloads it with the model). The reader opens only the vocabulary and the header of the Gyro file, so@@@ -269,8 -325,9 +325,8 @@@ Single RTX 4090 smoke run (Gyro-S, MTP- **Not in this port** (rc2 has them; see the list at the end of this page): the prompt helper on a second GPU for a Gyropack. Setup of two cards still runs the layer split and the decode peer; the prompt peer says it is not used for a- Hadamard-folded pack and the prompt stays on the first card. Gyro-L and Intel Arc (SYCL) are not supported.- - **Source builds:** the SYCL tree builds with these sources (P1006, 0 errors) but has no trellis GPU kernels.- Hadamard-folded pack and the prompt stays on the first card. Gyro-L and Apple Metal are not supported.-- **Source builds:** the SYCL tree has the trellis kernels (Intel Arc, above); the Metal- engine builds and refuses the file at load (`native_expert_supported`).++ Hadamard-folded pack and the prompt stays on the first card. Gyro-L is not supported.++- **Source builds:** the SYCL tree has the trellis kernels (Intel Arc, above), and so has the Metal engine (On a Mac, below).- **Not measured yet:** token parity against llama.cpp.- **Benchmark mode only:** `strata --tokens-file ... --max-new N` decodes N tokens past the end of the answer;diff --cc docs/MODELS.mdindex 9c755098d,a828be85d..7662a6d1b--- a/docs/MODELS.md+++ b/docs/MODELS.md@@@ -19,7 -19,7 +19,7 @@@ other size stays a choice. A PC with a| Your memory (RAM + VRAM) | Pre-selected | Notes || --- | --- | --- || **32 GB** | **Gyro-S**, or the **Coder** for code | The Coder needs 32 GB of RAM and keeps half of the experts, so it is weaker outside code ([why](#coder)). Gyro-S has lower quality than the 2-3-bit sizes, and the 2-bit Q2_0 decodes faster |- | **40 GB** | **Swift 1.5** IQ2_XS (39.2 GB) | Gyro-M (35 GB) is the other choice: close to IQ3_XXS in quality, but it writes answers 17-21% slower than Q2_0. Gyro runs on NVIDIA and AMD cards and, from 0.2.2, on Macs (Gyro-S measured on a 32 GB Mac mini), not on Intel Arc |-| **40 GB** | **Swift 1.5** IQ2_XS (39.2 GB) | Gyro-M (35 GB) is the other choice: close to IQ3_XXS in quality, but it writes answers 17-21% slower than Q2_0. Gyro runs on NVIDIA, AMD and Intel Arc cards, not on the Mac |++| **40 GB** | **Swift 1.5** IQ2_XS (39.2 GB) | Gyro-M (35 GB) is the other choice: close to IQ3_XXS in quality, but it writes answers 17-21% slower than Q2_0. Gyro runs on NVIDIA, AMD and Intel Arc cards and, from 0.2.2, on Macs (Gyro-S measured on a 32 GB Mac mini) || **48 GB** | **IQ3_XXS** (47.0 GB) | Slower, better || **64 GB** | **IQ3_S** (54.8 GB), the original. Swift 1.5's IQ3_S is an equal choice | The slowest, the best: it matches the full model on the published tests || **96 GB or more** | [Unsloth's UD-IQ4_XS to Q8_0](#unsloths-files-ud-iq4_xs-to-q8_0), 4 to 8 bit | UD-IQ4_XS keeps every expert in RAM from about 80 GB of RAM, Q8_0 from about 136 GB. Up to 192 GB, the 5-8-bit files fit in RAM. Setup still pre-selects IQ3_S here, except on a Strix Halo |@@@ -183,7 -183,7 +183,7 @@@ experts in a rotated basis. They are th| **Gyro-S** | 58.5 GB | 27.6 GB | the smallest option, for PCs with little memory; lower quality || **Gyro-M** | 92.0 GB | 35 GB | about IQ3_XXS quality with about 20% less GPU memory; decodes about 20% slower than Q2_0 on 12 GB cards |- NVIDIA, AMD (experimental) and, from 0.2.2, Apple Silicon Macs ([MAC.md](MAC.md#gyro-s-and-gyro-m-agentionais-trellis-experts): Gyro-S is measured on a 32 GB Mac mini, Gyro-M only tensor by tensor); not Intel Arc. Gyro reads pictures (the same rule as above). It needs-Gyro runs on NVIDIA and AMD (experimental) cards and on Intel Arc cards on Linux (tested on an Arc A750; the Arc engine is built from this release's source, see [INTEL.md](INTEL.md)); not on the Mac. Gyro reads pictures (the same rule as above). On NVIDIA and AMD it needs++Gyro runs on NVIDIA and AMD (experimental) cards and on Intel Arc cards on Linux (tested on an Arc A750; the Arc engine is built from this release's source, see [INTEL.md](INTEL.md)) and, from 0.2.2, on Apple Silicon Macs ([MAC.md](MAC.md#gyro-s-and-gyro-m-agentionais-trellis-experts): Gyro-S is measured on a 32 GB Mac mini, Gyro-M only tensor by tensor). Gyro reads pictures (the same rule as above). On NVIDIA and AMD it needsengine 0.1.45.1 or newer; if the engine is older, the app says "This model needs a newer engine" and offers Updateengine. Gyro gives correct output on RTX 50 cards with engine 0.1.45.3. Details, measurements and credit:[GYRO.md](GYRO.md).