Qwen3.8-Flash-Next on any consumer hardware: one-click install for Windows / Linux. Strata inference engine, OpenAI/Anthropic API on localhost, optional image input.
C++
Commits on main
desktop: host_command test (loopback bind forced, shutdown secret, plain refusal); Cargo.lock follows the app version
9b75c6a Niko1221 committed 1 month ago
setup_intel: recommend --prefill 8192 for a Battlemage card in the borrowing (over 32K context) config, with the measured numbers and a test
219ae43 Niko1221 committed 1 month ago
gfx12: STRATA_HIP_WMMA=auto (prompt attention on matrix cores chosen per call, FP32 fallback on a failed launch); Split traits for Q4_K/Q5_K/Q8_0 (STRATA_KQ_SPLIT=1, bitwise, opt-in) with iq_multi_parity cases
79ac316 Niko1221 committed 1 month ago
gfx12: the native Q2_0 pack's gate/up take the fused int8 prompt experts by default (STRATA_PF_FUSED=0 keeps MMQ)
2c6bfef Niko1221 committed 1 month ago
gfx12: the matrix-core prompt attention (STRATA_HIP_WMMA) is the default; STRATA_HIP_WMMA=0 turns it off
99f6d47 Niko1221 committed 1 month ago
sycl: STRATA_FOLLOW / STRATA_FOLLOW_LOGPOS test path in the serve decode loop (teacher-forced KL), off unless set; measurement tooling
577d644 Niko1221 committed 1 month ago
Prefill planner: price the host (RAM page cache, displaced experts, drive) when choosing chunk and ring (#2824)
e77f1df Niko1221 committed 1 month ago
tester READMEs: --save-logs, crash log location, the app version from Cargo.toml
4306182 Niko1221 committed 1 month ago
desktop shell: logs, crash log, --save-logs; the window blocks startViewTransition; one app version (Cargo.toml, 0.2.0-beta); banner while the bundled engine unpacks; diagnostics include the desktop logs
1b003bd Niko1221 committed 1 month ago
Pictures: untick means does not read, API refusal hint, e2e catalog check skips known false
e4ed5d1 Niko1221 committed 1 month ago
Pictures: plainer refusal wording, e2e reads answer tokens only
52f50ba Niko1221 committed 1 month ago
Pictures reach models: catalog marks picture-capable models, API models take image_url, import knows picture readers
a3cf8a6 Niko1221 committed 1 month ago
make-tester-readme --verify: hash only the files the README names; a sentence that merely names a file is not a stale hash
01c8381 Niko1221 committed 1 month ago
make-tester-readme: templates may have CRLF (archives of a Windows checkout)
1b27554 Niko1221 committed 1 month ago
sycl: PcieAuto on SYCL, opt-in STRATA_PCIE_FRAC_DEFAULT=auto (single card, native pack): the PCIe share refined from the CPU pool's speed in the first decode windows
c1a5b13 Niko1221 committed 1 month ago
make-tester-readme: templates may have CRLF (archives of a Windows checkout)
9d868f3 Niko1221 committed 1 month ago
gfx12: the native Q2_0 pack's gate/up on the fused int8 prompt experts (STRATA_PF_FUSED=1; opt-in until KL-checked)
3409d9a Niko1221 committed 1 month ago
sm_120: PF_FUSED default and per-token HC down blocks only on 80+ SM cards
b1e0fda Niko1221 committed 1 month ago
tester READMEs: templates with checksums computed from the files, make-tester-readme.sh (+ --verify), test
a0469e9 Niko1221 committed 1 month ago
desktop: tester README templates (hashes filled at build time), plain_path warning
e116834 Niko1221 committed 1 month ago