Qwen3.8-Flash-Next on any consumer hardware: one-click install for Windows / Linux. Strata inference engine, OpenAI/Anthropic API on localhost, optional image input.
C++
Commits on main
Batch groups: PROPOSED NVIDIA two-card default is one serial group (measured +12..16% on 2x A4000); owner decides
f680a80 Niko1221 committed 1 month ago
App settings: the Allow browser origins help says it does nothing in the app, that the app's API already allows pages of any site, and where cors_origins really goes; text in all 8 languages and in DETAILS (#3208)
d8a6a0e Niko1221 committed 1 month ago
Chat: LaTeX math is drawn with KaTeX (inline $..$ and \(..\), display $$..$$ and \[..\]); KaTeX and its woff2 fonts ship with the app and load only when an answer has a formula; money and code stay text (#3268)
3cc18d7 Niko1221 committed 1 month ago
FP4-Local: setup installs the pinned torch, transformers and safetensors the converter imports (requirements-nvfp4-local.txt) right before a prepare that runs; the tool names a missing package up front instead of after 20 minutes (#3227)
1994f3a Niko1221 committed 1 month ago
Windows installer: ask for the install folder (another drive when C: is short), keep the earlier folder in app updates and silent installs; docs name what stays on C: (#3186 #3190)
c911065 Niko1221 committed 1 month ago
HIP prefill: no start-up hipBLAS warm-up when the cards are of more than one architecture (#3204)
4e76d6c Niko1221 committed 1 month ago
App: a start that stopped for no VRAM left for the expert cache is tried once more with less kept free (#3192); a model on the person's own GGUF folder keeps that folder, so a reload does not download it (#3199)
8441cfd Niko1221 committed 1 month ago
docs: build from git on Linux (clone, setup, rebuild, trying a pull request, engine env, the monitor from a checkout, plain cmake) (#3191)
9cc2a9b Niko1221 committed 1 month ago
tools: gguf-py is also looked up in the install folder (STRATA_INSTALL_DIR, the app's folder), so tools run by hand from the Control package find what setup.py downloaded; the error names STRATA_GGUF_PY (#3269)
9b8436d Niko1221 committed 1 month ago
Linux: say it when a finite RLIMIT_RTTIME (PipeWire without rtkit) is the reason for an engine death by signal 9, warn at start, troubleshooting entry (#3238)
c6a20b7 Niko1221 committed 1 month ago
CPU pool: the LP-E cores (/sys/devices/cpu_lowpower/cpus) are efficiency cores, in the engine and in setup (#3262)
88b29d4 Niko1221 committed 1 month ago
Radeon 780M: the matrix-core prompt set is the default on gfx1103 (integrated, Linux): prompts x1.6 at 1K and x2.0 at 4K, decode unchanged, same greedy ids; STRATA_IGPU_PROMPT_SET=0 turns it off; gfx1150/1151 and Windows stay off; docs note the MES reset issue; per-arch tests
eb7eac2 Niko1221 committed 1 month ago
Intel Arc pictures: on by default for the Alchemist cards (CPU reader), Battlemage stays opt-in; SYCL GPU picture reader (strata-vision-sycl) for --vision gpu; reader rule in vision_reader.py; tests and docs
cac4816 Niko1221 committed 1 month ago
hipBLASLt tuning table on by default on Strix Halo (gfx1151) only, the owner's choice; opt-in elsewhere
4ed8eb0 Niko1221 committed 1 month ago
arch_defaults: UMA arena is not a default (measured slower, resets not fixed): constant off, STRATA_ARENA_PIN_GIB=none stays opt-in; docs say the iGPU prompt set is opt-in with the 780M numbers
b203b5f Niko1221 committed 1 month ago
AMD packages carry the hipBLASLt tuning tables; the engine start picks the one for the card
c6aa422 Niko1221 committed 1 month ago
Mac pictures: signing smoke checks strata-vision, docs and the 7 READMEs say the Mac reads pictures
509466a Niko1221 committed 1 month ago
Docs: BENCHMARK_PROTOCOL (implemented, still draft: field mapping, Metal, versions, runner reading, SECURITY link), COMMUNITY_BENCHMARKS, TERMINAL; BENCH.bat, bench.sh and strata_bench.py point to strata bench run
c8e5d2f Niko1221 committed 1 month ago
strata bench run: the standard benchmark protocol (standard-v1 is the default suite); fixtures and COMMIT file in the Terminal archive; tests with a mock server
6d41b37 Niko1221 committed 1 month ago
Standard benchmark: frozen fixtures (bench/prompts/standard-v1) and the tool that builds them
e1ef9df Niko1221 committed 1 month ago