Qwen3.8-Flash-Next on any consumer hardware: one-click install for Windows / Linux. Strata inference engine, OpenAI/Anthropic API on localhost, optional image input.
C++
Commits on main
metal: THE ENGINE GENERATES TOKENS ON THE MAC - 17 more kernels, the whole path runs
33bf441 Niko1221 committed 27 days ago
release notes: the run-to-run difference is near-tied words, not only expert placement
d50da4e Niko1221 committed 27 days ago
dsv41 store zero-copy: clear the device's zc_tab entry when VRAM takes an expert over (a stale pointer into a reused slot made zc_stage copy another expert's blob into the plan: garbage, NaN routing, illegal access)
624a226 Niko1221 committed 27 days ago
dsv41 serve: with slots off the loop is as before (no anchor copy, same continuation test on an empty engine)
fa3252a Niko1221 committed 27 days ago
DeepSeek-V4.1: slot keep and auto-pin default off (switches STRATA_DS4_SLOT_KEEP=1, STRATA_DS4_AUTO_PIN=1)
e2361d8 Niko1221 committed 27 days ago
launch: the last lines suggest 'strata launch --stop' (and --save-preset NAME to keep the settings) when no preset was saved; --preset "<name>" only when one exists; tests
afd24ea Niko1221 committed 27 days ago
pack_gguf: an Engram file ('engram' or 'deepseek41-engram') is never taken for a model shard or for the model's metadata; real header fixture and tests; setup test: the first release's files are packed as they are with no shard download
4ebba26 Niko1221 committed 27 days ago
release notes: the 99.75% is agreement between skip on and off over 799 positions
2e477ec Niko1221 committed 27 days ago
DeepSeek table: the IQ4_NL Engram table row (README and 6 translations, DEEPSEEK41.md, release notes); notes: long-prompt skip and the 32,768 thinking budget
0e121c7 Niko1221 committed 27 days ago
serve: DeepSeek-V4.1 thinks at most 32768 tokens when neither the request nor the config names a budget
dfe29bc Niko1221 committed 27 days ago
README: R9700 numbers in the DeepSeek block (11 tokens/s on one card, 4x about 31, 55 to 69 with DSpark); the same block in the six translated READMEs; release notes: one-card R9700 row
f51b80c Niko1221 committed 27 days ago
launch: the hsa_exception sentence ignores hsaKmt lines, and a real cause in the same log (out of memory, no permission on the card) still wins; tests for both
41e804d Niko1221 committed 27 days ago
docs: the final DeepSeek quants (ISTA-DASLab repository) in the release notes and DEEPSEEK41.md
524ff90 Niko1221 committed 27 days ago
README: DeepSeek V4.1-Flash (ISTA-DASLab IQ2_XXS / IQ2_XS) in the model list, Terminal only
fa77717 Niko1221 committed 27 days ago
launch: a GPU runtime start failure (hsa_exception) says the card was not ready, with a next step; the runtime text stays in the log
60d847b Niko1221 committed 27 days ago
serve: DeepSeek-V4.1 with a short max_tokens (48-1023) caps the thinking at half of it, so a text block always arrives
b4418e3 Niko1221 committed 27 days ago
dsv41: a long prompt skips layers 20-39 on all but its last 2,668 rows (STRATA_DS4_PROMPT_SKIP, on by default)
8a7102e Niko1221 committed 27 days ago
DeepSeek-V4.1: slots on by default (2 GB cap, one week), docs
be26cb7 Niko1221 committed 27 days ago
serve: DeepSeek-V4.1 engine gets the slot switch and a slot folder in Strata's data folder (other families untouched)
736a413 Niko1221 committed 27 days ago
tools/dsv41/slot_keep_test.py: two agents taking turns, fresh reads vs shared start vs slots vs restart vs folder cap
1d31e2a Niko1221 committed 27 days ago
serve: DeepSeek-V4.1 marks the system prompt and tools as the shared start (pin=N) so a sub-agent goes back to it
b8f9c63 Niko1221 committed 27 days ago