Qwen3.8-Flash-Next on any consumer hardware: one-click install for Windows / Linux. Strata inference engine, OpenAI/Anthropic API on localhost, optional image input.
C++
Commits on main
[Engine] SYCL: the prompt attention batch is budgeted where it is allocated, and stays 32 by default
870aedd Niko1221 committed 21 days ago
Version 0.2.8: Terminal and app 0.2.8, engine and Control 0.1.54 (every Qwen and DeepSeek package, Metal and SYCL included)
36f6663 Niko1221 committed 21 days ago
Merge f-028-monitor: the Monitor keeps the app's own GPU readings where the engine has none (AMD on Windows), reads Windows AMD temperature, and drops non-GPU display chips on Linux (#3727)
1bf946e Niko1221 committed 21 days ago
Monitor: AMD cards keep their readings while an engine runs, Windows AMD temperature, no remote-console chip as a GPU (#3727)
5e8f47c Niko1221 committed 21 days ago
Merge f-028-arcb65-pipe: pipelined B-series (two Battlemage stages) is the default
18200cf Niko1221 committed 21 days ago
Merge f-028-arcb65: SYCL lane-cell prompt attention for Battlemage only, and the Arc B-series work
cf05918 Niko1221 committed 21 days ago
window_limits_test: setenv/unsetenv for MSVC (the Windows test build stopped on it)
b119f40 Niko1221 committed 21 days ago
docs: two Arc B-series cards decode with the pipelined windows by default
8d5be82 Niko1221 committed 21 days ago
Setup and the launcher write --spec 2 for exactly two Arc B-series cards
74e1f86 Niko1221 committed 21 days ago
[Engine] SYCL: --pipeline-windows 2 is the default on exactly two Arc Battlemage cards
a6fd788 Niko1221 committed 21 days ago
Merge f-028-nerazim: DeepSeek stop ids (test_dsv41 stop-id assertion follows the fix; the arch_from_tokenizer cherry-pick is eng-p1's)
d76b506 Niko1221 committed 21 days ago
Merge f-028-defaults2: route prior off by default, tool_call_recovery on
95563ff Niko1221 committed 21 days ago
docs: windows of 16 rows and the four-card AMD profile (BATCHING.md)
5c8bcf4 Niko1221 committed 21 days ago
Four-card AMD serving profile: 32 slots in 4 groups, split 13,26,39, chunk 2048 (setup and launcher)
4fdb563 Niko1221 committed 21 days ago
Verify and batch windows of up to 16 rows: HIP builds default to 16, narrow builds unchanged
9d3c8c3 Niko1221 committed 21 days ago
Metal DeepSeek: stop leaking Metal buffers and command buffers (16 -> 3 tok/s after a few requests)
061c542 Niko1221 committed 21 days ago
[Engine] SYCL: the lane-cell prompt attention default is for Battlemage (Xe2) cards only
f2bf7a3 Niko1221 committed 21 days ago
[Engine] SYCL: native_expert_bench reports microseconds, not milliseconds
6124c35 Niko1221 committed 22 days ago
[Engine] SYCL: native_expert_bench refuses to time a launch that wrote nothing
8475011 Niko1221 committed 22 days ago
[Engine] SYCL: refuse a --mtp-q4 draft head when the Q6_K head is stored as planes
8925393 Niko1221 committed 22 days ago
[Engine] SYCL: copy the prompt path's grouping tables instead of reading them from mapped memory
e318f71 Niko1221 committed 22 days ago
[Engine] SYCL: a pipelined window never self-commits, so --pipeline-windows 2 is token-exact
bf8d88b Niko1221 committed 22 days ago
[Engine] SYCL: print the pipelined commit's count when a state dump is requested
7356aa1 Niko1221 committed 22 days ago