Qwen3.8-Flash-Next on any consumer hardware: one-click install for Windows / Linux. Strata inference engine, OpenAI/Anthropic API on localhost, optional image input.
C++
Commits on main
Release notes 0.2.1: the R9700 queue fix with the two-queue numbers
b42ec66 Niko1221 committed 1 month ago
amd: open two GPU queues instead of five at start (keeps the fixed prompt speed, no decode loss on R9700)
b35a981 Niko1221 committed 1 month ago
Release notes 0.2.1: engine 0.1.46 and feed sequence 102 (proposed), file-name and Docker TODOs resolved, tuning tables per package
d33bb83 Niko1221 committed 1 month ago
build_hip_linux.sh: pick up lib/rocm_sysdeps when the ROCm tree has it (the gfx1151 halo package needed a patched copy in 0.2.0-beta)
3e7c5d8 Niko1221 committed 1 month ago
Version bump for 0.2.1 (proposed): app 0.2.1, engine and Control 0.1.46
894d1be Niko1221 committed 1 month ago
Release notes 0.2.1: fill the iD, iE, zc and bimodal parts (measured defaults, fixes, known limits)
93aa62e Niko1221 committed 1 month ago
Linux file tier: a start-up drive probe overrides the room rule's file cache on a fast drive (#3237)
484e06b Niko1221 committed 1 month ago
Linux: io prefetch + decode gate by default for experts.bin packs when the page cache has room for 55% of the experts
ecf2bdc Niko1221 committed 1 month ago
amd: open the GPU queues in a fixed order at start (R9700 fast/slow prompt starts)
3f1fa67 Niko1221 committed 1 month ago
Release notes 0.2.1 (draft): downloads table, what is new, measured defaults, fixes, privacy, known limits, TODO markers for the running streams
24e5653 Niko1221 committed 1 month ago
SYCL: build.sh stops an AOT Battlemage build before the compile when ocloc is the one that crashes on the int8 kernels (Compute Runtime 26.22.38646.x, IGC 2.36.3); I8_ESIMD=OFF / STRATA_SYCL_I8_ESIMD builds without them; docs say docker build --pull (#3219)
8e957cd Niko1221 committed 1 month ago
apps/host staging-scripts-syntax test: use Git bash with forward-slash paths on Windows instead of the WSL launcher
1f52a00 Niko1221 committed 1 month ago
math test: the KaTeX render check skips when katex is not installed in a shared node_modules (#3268)
e68a032 Niko1221 committed 1 month ago
gfx906 (HIP wave64) builds again: no Qwen3.6 engine (cuBLAS calls the compat layer does not map), GGML_USE_HIP on the W4A4 target, the trellis overlay sources and the moe_f16_kq stub in the HIP source list; all targets compile for gfx906 (#3172 #3271)
10715d8 Niko1221 committed 1 month ago
Your own engine settings are kept: user_args, a reserve of 0 on a compute-only card, control vectors survive a load (#3215 #3270 #3216)
8aaf188 Niko1221 committed 1 month ago
docs: dual-socket CPU pool measurements (workers across sockets won on one box, lost on another), IOMMU check, no numactl pinning (#3201)
b1713b3 Niko1221 committed 1 month ago
docs: two-card gfx906 tip, --pipeline-windows 2 (+36% decode) and --trim-stage-weights (+5% prompt) measured on 2x MI50, off by default (#3173)
0875029 Niko1221 committed 1 month ago
GPU choice (0.2.1): Automatic skips cards the engine cannot run, one card sent as gpu, settings-file GPUs kept, readable dropdown, Monitor opens on assigned cards (#3203 #3195 #3256 #3221 #3211)
952cce7 Niko1221 committed 1 month ago