Qwen3.8-Flash-Next on any consumer hardware: one-click install for Windows / Linux. Strata inference engine, OpenAI/Anthropic API on localhost, optional image input.
C++
docs/GYRO.md: read as part of Strata (no fork clone step); render-group note for HIP containers
Laurent Zuijdwijk7709a0e2c89d
diff --git a/docs/GYRO.md b/docs/GYRO.mdindex b033273d9..8e34e6332 100644--- a/docs/GYRO.md+++ b/docs/GYRO.md@@ -19,11 +19,7 @@ Qwen3.8-Flash-Next models. It is not the GGUF draft file from the Gyro repositor## Quick setup-Gyro support lives on the `rc1` branch of the agentionai fork:--```sh-git clone -b rc1 https://github.com/agentionai/Strata && cd Strata-```+From a Strata checkout:`tools/gyro_setup.sh` does every step below on Linux:@@ -45,7 +41,8 @@ git clone --depth 1 https://github.com/agentionai/llama.cpp ../agention-llama.cp# NVIDIA. RTX 50 series: use CUDA 13 (CUDA 12.8 crashes the prompt path on sm_120: issues #220, #224)cmake -S . -B build -G Ninja -DCMAKE_BUILD_TYPE=Release -DSTRATA_ENABLE_CUDA=ON \-DCMAKE_CUDA_ARCHITECTURES=120 -DSTRATA_GGML_DIR=$PWD/../agention-llama.cpp-# AMD (experimental: kernel parity validated on gfx1151, plus a short end-to-end run there)+# AMD (experimental: kernel parity and an end-to-end run validated on gfx1151; in a non-root container add+# --group-add $(getent group render | cut -d: -f3), otherwise HIP finds no device)cmake -S . -B build -G Ninja -DCMAKE_BUILD_TYPE=Release -DSTRATA_ENABLE_HIP=ON -DSTRATA_PREFILL_MMQ=ON \-DCMAKE_HIP_ARCHITECTURES=gfx1201 -DSTRATA_GGML_DIR=$PWD/../agention-llama.cppcmake --build build -j@@ -111,7 +108,7 @@ from RAM; nothing else changes.## MeasuredAll runs: greedy or the stated sampling, same prompt tokens as llama.cpp, MTP draft `--spec 4 --spec-min-p 0.5`,-int8 KV. "llama.cpp" is the agentionai fork with the CUDA trellis fixes (branch `cuda-tq-fixes`).+int8 KV. "llama.cpp" is the agentionai fork with the CUDA trellis fixes (in its `main` since 2026-10-04).### RTX 5090 (32 GB), Gyro-S, all experts on the GPU (2026-10-03)