Qwen3.8-Flash-Next on any consumer hardware: one-click install for Windows / Linux. Strata inference engine, OpenAI/Anthropic API on localhost, optional image input.
C++
Commits on main
docs: MULTI_GPU.md - an unequal pair under layer-split auto (#2644, measured on z440 with the speed-scale seam), STRATA_SPLIT_UNIFORM (#2418)
45f6111 Niko1221 committed 1 month ago
delete a downloaded native model: strata_remove (own files and run config, shared files kept), Delete in Models and Storage, real disk use per model
ffbc606 Niko1221 committed 1 month ago
Gyro: the CPU trellis kernels run on every CPU (scalar without AVX2: upstream ggml has no trellis vec_dot to fall back to); the SYCL build lists the new CPU sources
eca3aef Niko1221 committed 1 month ago
Catalog: Gyro-S and Gyro-M (agentionai/Qwen3.8-Flash-Next-Gyro-GGUF) in setup, the Terminal, the app and the MCP server
ba64156 Niko1221 committed 1 month ago
request slots: fit to the expert cache the card would have (measured), hardware from the host probe, safe default with no read
ec53cae Niko1221 committed 1 month ago
stage-harness: peers, safe pruning; profile: office converter off
697cbc6 Niko1221 committed 1 month ago
docs/GYRO.md: the CPU trellis kernels and their switches
701f319 Laurent Zuijdwijk committed 1 month ago
native_expert_parity: check the CPU trellis kernels in the synthetic modes
5ebea67 Laurent Zuijdwijk committed 1 month ago
CPU trellis kernels: AVX2 / AVX-512 decode-and-dot for TQ2_T / TQK6 / TQK7
d0a02fe Laurent Zuijdwijk committed 1 month ago
APR on 0.1.40: the sub-16 gate/up rows assume 80 dots per row; trellis types (qk 128) take the full-warp kernel
25a1f6e Laurent committed 1 month ago
hadamard_rows: say what is wrong with a bad block before exiting
84507d7 Laurent Zuijdwijk committed 1 month ago
prefill: say why the FP16 path rotates H in place in fp16
86faf03 Laurent Zuijdwijk committed 1 month ago
iq_pack: refuse to mark a native_experts.txt other than v3/v4 as v5
4557f68 Laurent Zuijdwijk committed 1 month ago
prefill: resolve the APR sign vectors once per device, not per layer and chunk
8fd8e6d Laurent Zuijdwijk committed 1 month ago
prefill: look up the APR sign vectors at the layout's widths, not 640 / N
dd32704 Laurent Zuijdwijk committed 1 month ago
Trellis numerics: say which codebook each path reads and what is bitwise
390da5d Laurent Zuijdwijk committed 1 month ago
verify: carve the rotated expert input only for Hadamard-folded packs
99581ed Laurent Zuijdwijk committed 1 month ago
APR packs: drop the STRATA_APR opt-in; warn only on unvalidated setups
294c95e Laurent Zuijdwijk committed 1 month ago
docs/GYRO.md: read as part of Strata (no fork clone step); render-group note for HIP containers
7709a0e Laurent Zuijdwijk committed 1 month ago
docs/GYRO.md: RTX 30-series setup line, RTX 4090 validation and the two-GPU notes
cce9b16 Laurent Zuijdwijk committed 1 month ago
docs/GYRO.md: 2026-10-03 results (5090 #2, Gyro-M, 3090, AMD smoke); fix Gyro-S size
926171c Laurent committed 1 month ago
APR port: Split<144..146>::load takes upstream's STAGE_GRID form
f5b7628 Laurent Zuijdwijk committed 1 month ago
APR port: multi-GPU prompt offload (peer, layer split helper) for Hadamard-folded packs
28651a4 Laurent Zuijdwijk committed 1 month ago
APR trellis decode: int8 codebook + dp4a in tq_load / tq_apply
b4e477c Laurent committed 1 month ago
gyro_setup.sh: --prefill auto, like setup.py writes for the GSQ-RCO models
81aef75 Laurent committed 1 month ago
gyro_setup.sh: export STRATA_GGUF_PY for every step (mtp_pack.py needs it too)
75d9b26 Laurent Zuijdwijk committed 1 month ago
gyro_setup.sh: point the HIP build at ROCm (ROCM_PATH or /opt/rocm)
2fce1e1 Laurent Zuijdwijk committed 1 month ago
gyro_setup.sh: set up the venv first and build with its cmake/ninja (distro cmake can be < 3.24)
e05565e Laurent Zuijdwijk committed 1 month ago