Qwen3.8-Flash-Next on any consumer hardware: one-click install for Windows / Linux. Strata inference engine, OpenAI/Anthropic API on localhost, optional image input.
C++
Commits on main
launch for DeepSeek: the tune text says what it really does and its result lists what was timed (or that nothing could be compared); the plan names an installed DeepSeek engine ('installed, 0.1.49') instead of saying setup will download it; preset test; tests
5be4964 Niko1221 committed 27 days ago
DeepSeek engine by hand: --dsv41-package FILE (setup and strata launch) or a file put in engine-dsv41/; the package is checked (DeepSeek engine for this system, signed manifest, every file's hash) before it is installed; plain steps in the missing-engine message and docs; tests
71c674d Niko1221 committed 27 days ago
dsv41 prompts: expert copies keep going while the host waits for the routing (flow_pump on the busy stream); DS4_FLOW_PUMP_WAIT=0 as before
0d38517 Niko1221 committed 27 days ago
dsv41 CPU lane: two cores left free beside the host thread when the lane would take every logical CPU; STRATA_DS4_LANE_FREE=0 as before
e51e84e Niko1221 committed 27 days ago
dsv41 serve: Stop ends a long prompt's reading at a layer/chunk and keeps the conversation before it (set_cancel / cancelled)
cffd240 Niko1221 committed 27 days ago
release notes 0.2.4: the DeepSeek engine is a separate download (automatic and by hand), Qwen engines unchanged
062fd4a Niko1221 committed 27 days ago
dsv41 DSpark: cumulative cut on the drafts (product of confidences >= 0.5); STRATA_DS4_DSPARK_CUM, request key dspark_cum, 0 off
f73ae5a Niko1221 committed 27 days ago
dsv41 CPU lane: prefetch only the IQ experts' pages not in RAM (os::prefetch_cold); DS4_IQ_PF_ALL=1 as before
e6e14f2 Niko1221 committed 27 days ago
dsv41 Windows: Engram rows read unbuffered from their unmapped file; DS4_EG_DIRECT=0 as before, DS4_EG_CHECK compares against a buffered read
a6cbc36 Niko1221 committed 27 days ago
dsv41 Windows: 64 Engram reader threads (each ReadFile is synchronous, so the threads are the queue depth); DS4_ENGRAM_THREADS overrides
aee5db5 Niko1221 committed 27 days ago
dsv41 Windows: 1 ms timer resolution while the engine runs; DS4_TIMER_MS=0 leaves it
611c170 Niko1221 committed 27 days ago
dsv41 Windows: queued GPU work submitted at once on NVIDIA too (win_submit), after every flag hand-off; DS4_WIN_SUBMIT=0 turns it off
5ec845f Niko1221 committed 27 days ago
dsv41: gfx12 WMMA expert tiles on by default (STRATA_DS4_HIPK=0 turns them off)
a23b5f2 Niko1221 committed 27 days ago
dsv41: gfx12 WMMA prompt tiles for the i-quant expert sets (STRATA_DS4_HIPK=1, default off)
94413c7 Niko1221 committed 27 days ago
dsv41: finer DS4_PROF for the chunked prompt (stages, expert kernels by type)
4278304 Niko1221 committed 27 days ago
serve: a DeepSeek-V4.1 pack that ships the V4-Flash chat template (tool_calls, no space) is rendered with the V4.1 template, so tool calls come back as real calls; STRATA_DEBUG prints the raw ids; test
70efffb Niko1221 committed 27 days ago
setup: banner names the chosen family; the user's own home (root's included) is allowed as a data folder; a missing DeepSeek engine package is said plainly (supported cards), the developer hint only with --verbose; tests
00ce920 Niko1221 committed 27 days ago
launch: the plan says 'drafting DSpark' for DeepSeek, not MTP; test
18022ce Niko1221 committed 27 days ago
dsv41 tune: with the drafter on, also try a draft block of 3 against the pack's own
1904c02 Niko1221 committed 27 days ago
setup: shared DeepSeek files (drafter, Engram) are also looked for two folders above the set's own folder (strata launch passes .../off/2.00bpw); test
642e769 Niko1221 committed 27 days ago
setup: DeepSeek's engine comes from the signed feed's dsv41 member (strata_control/dsv41_engine.py: same download, resume and verification as an engine update) into engine-dsv41/, beside the engine; the flat-zip route is dropped; tests
1d0a805 Niko1221 committed 27 days ago