Qwen3.8-Flash-Next on any consumer hardware: one-click install for Windows / Linux. Strata inference engine, OpenAI/Anthropic API on localhost, optional image input.
C++
Commits on main
[Engine] SYCL: the pipelined commit skips the graph for a one-token window
11d3375 Niko1221 committed 22 days ago
[Engine] SYCL: a state dump for the pipelined windows, and the two defects it already shows
478964e Niko1221 committed 22 days ago
[Engine] SYCL: the prompt attention's query batch is 128 by default
09524eb Niko1221 committed 23 days ago
[Engine] SYCL: prompt attention takes the lane-cell score phase, +5% on a prompt read
949f77c Niko1221 committed 23 days ago
[Engine] SYCL: a layer-split stage must be a GPU of the primary device's backend
7e0f719 Niko1221 committed 23 days ago
[Engine] SYCL: make the prompt attention's query batch a switch, and measure it
f7570e2 Niko1221 committed 23 days ago
[Engine] SYCL: the grouped-expert bench reports a device-side launch failure instead of silently timing nothing
d56565c Niko1221 committed 23 days ago
[Engine] SYCL: build the grouped-expert bench, and port it to SYCL
da3df90 Niko1221 committed 23 days ago
[Engine] SYCL: the verifier's stage profile reads its stamps on its own stream
16ccaf6 Niko1221 committed 23 days ago
[Engine] SYCL: --pipeline-windows runs again (three DPCT migration defects)
11a7228 Niko1221 committed 23 days ago
Server: only a one-token end marker is a stop id; pieces of <|im_end|> no longer end a DeepSeek reply ("Nerazim" came out as "Neraz", #4576)
43f32b3 Niko1221 committed 21 days ago
serve: tool_call_recovery is on by default; "tool_call_recovery": false is the off switch
3fcb210 Niko1221 committed 21 days ago
Residency-biased routing (STRATA_ROUTE_PRIOR) is off by default again on 12 GB NVIDIA cards (#4402)
20a63cf Niko1221 committed 21 days ago
Server: a config that names no "arch" but ships DeepSeek's tokenizer is served as deepseek41 (#4137)
72a2b77 Niko1221 committed 22 days ago
Qwen: the automatic expert cache leaves the reserve it was asked to keep - the ~245 MiB the load allocates after it are priced (#4474)
cfa197e Niko1221 committed 22 days ago
DeepSeek engine: a layer split's chunked prompt no longer deadlocks - the host waits for another group's flag before it queues the device-side wait (2x H100, IST-DAS-2.25bpw)
22fb183 WenyuanXu committed 22 days ago
serve: an engine left behind by an earlier run is waited for until it has given its memory back (#4051)
01d6f7b Niko1221 committed 22 days ago
engine: wait up to 20 s for the RAM the expert arena needs, then load with a plainer warning (#4051)
07d5ecf Niko1221 committed 22 days ago
Server: a config that names no "arch" but ships DeepSeek's tokenizer is served as deepseek41 (#4137)
b18292d Niko1221 committed 22 days ago
serve: damaged tool-call arguments, a stray closing think tag and a missing </function> no longer cost the call (#4427 #4077)
d711327 Niko1221 committed 22 days ago
CUDA 12 driver floor: setup takes it from the engine package, not from a constant (#4247, #4188)
84c7f43 Niko1221 committed 22 days ago
Packaged Terminal: setup.py without CMakeLists.txt, and strata install hands its options to setup (#4188)
012bea5 Niko1221 committed 22 days ago
launch: do not point at an engine log that was never written (#3714)
5596cb2 Niko1221 committed 22 days ago
Qwen: the PLE residency policy gives its lock back when the lock is what leaves the automatic conversation cache too little RAM (#4518)
587a474 Niko1221 committed 22 days ago
DeepSeek engine: slot_load() writes each tensor-parallel member's window ring and compressor group under its own device (#4350)
35c0c9a Niko1221 committed 22 days ago
Conversation cache: parking an idle --batch slot no longer drops the main session's copy with the shared-prefix checkpoint (#4420)
c7a0cef Niko1221 committed 22 days ago
DeepSeek engine: the auto RAM store no longer reads a discrete GPU's pinned buffers as unified memory (#4147)
ea73eab Niko1221 committed 22 days ago
App host: DeepSeek launch arguments are built from what strata-dsv41 takes (#4358 #4359 #4505 #4507 #4504)
5ef90cb Niko1221 committed 22 days ago
GUI: ask for the longer wait only when all three of a Control's ceilings agree (#3459 #4191)
3e1141e Mike committed 23 days ago