Qwen3.8-Flash-Next on any consumer hardware: one-click install for Windows / Linux. Strata inference engine, OpenAI/Anthropic API on localhost, optional image input.
C++
Commits on main
metal: the routing trio ported ahead of its turn - moe_sort counts, bounds scan, fill
154c299 Niko1221 committed 27 days ago
metal: hc_split ported - the hyper-connection family is complete on the Mac
4735e38 Niko1221 committed 27 days ago
dsv41: staging ring 64 MB when the experts are within 30% of fitting the cards (R9700 x4 plain 2.00: ratio 1.16)
41856f6 Niko1221 committed 27 days ago
dsv41: the store fill after a chunked prompt reaches the store's whole capacity, not only its allocated slots
0beae0b Niko1221 committed 27 days ago
setup: DeepSeek official sets start with --prefill-chunk 1024 (layer-major prompt path, measured 231 tok/s at 8K on a 12 GB PC)
9469412 Niko1221 committed 27 days ago
metal: the hyper-connection family on the Mac - hc_post, hc_mix_scale, hc_mix ported
7022bd2 Niko1221 committed 27 days ago
setup: the two official IST-DAS DeepSeek-V4.1-Flash sets (2.00 / 2.25 bpw) as sizes: pinned files, shared Engram + DSpark, plain pack recipe, shipped profiles, pack-info and a 16-token text check, --dspark auto; fit words from the measured numbers
81dd215 Niko1221 committed 27 days ago
metal: finish_kernel<false> wired - the engine passes it and names item five
5d969ad Niko1221 committed 27 days ago
tests + ENGINE-COMPONENT.md: strata-dsv41 in the engine package and the --require-dsv41 refusal
4b5f8d8 Niko1221 committed 27 days ago
metal: finish_kernel<false> in MSL, verified by the AOT compiler
cb931e7 Niko1221 committed 27 days ago
Merge f-dsv41-cpul 02b07b686 into f-dsv41-rel (exact multi-row CPU-lane rows for IQ types, bit-identical to ggml-cpu, self-check per type, DS4_GG_IQ256=0 switch)
e838e2b Niko1221 committed 27 days ago
packaging: build_dsv41_windows.bat and build_dsv41_cuda.sh build strata-dsv41 for the NVIDIA release packages (sm_86 + sm_120 fat)
6053a43 Niko1221 committed 27 days ago
build_hip_linux.sh: build strata-dsv41 (own build tree) and ship it in the rx9070 package; DSV41=1|0 overrides, --require-dsv41 on the package
faaf82a Niko1221 committed 27 days ago
metal: the mHC dense product wired - cublasSgemm dispatches an MSL kernel instead of aborting
b5b4a97 Niko1221 committed 27 days ago
package_engine: ship strata-dsv41 beside the engine (picked up like the picture readers); --require-dsv41 refuses a package or a --verify without it
8fee63f Niko1221 committed 27 days ago
metal: the engine runs on Metal and names its kernel queue; two kernels ported
45cbb45 Niko1221 committed 27 days ago
pack_gguf: warn loudly when --skip-tensors / --dense-override are used on an official IST-DAS set (engram_k/q/wkv present): the rebuilt pack loads but gives garbage text; the plain recipe is right
7519b1c Niko1221 committed 27 days ago
dsv41: the layer-major run's RAM is given back before the cache catch-up and the store fill
dbf3bb2 Niko1221 committed 27 days ago
dsv41 iq: HIP keeps the release grids and kernels (no persistent work-item grid there)
86bdfbd Niko1221 committed 27 days ago
dsv41 iq: the IQ1_M code-table copy is CUDA only (kIq1mCodes does not exist on HIP; found by building the HIP-guarded paths under nvcc with -DSTRATA_USE_HIP)
796dbb7 Niko1221 committed 27 days ago
dsv41: after a chunked prompt the RAM store is filled with the prompt's hottest CPU-lane experts (a window prompt fills it through the CPU lane; the chunk path streams past it)
96a47b7 Niko1221 committed 27 days ago
dsv41 iq: kIq1mCodes is CUDA-only, so its use in load_tab_fast is under #if !STRATA_USE_HIP (HIP failed 'undeclared identifier kIq1mCodes': non-dependent names are looked up in the dead constexpr branch)
9c46ab8 Niko1221 committed 27 days ago
Merge f-dsv41-cuk a3d955201 into f-dsv41-rel (persistent grids only for codebooks >= 8 KiB: fixes 2.5x slowdown with 1 active expert)
1259503 Niko1221 committed 27 days ago
dsv41 iq test: golden compare also covers dynamic-count window groups (5/1/3 entries, ne_max 5; 9 groups with 4 live)
a3d9552 Niko1221 committed 27 days ago
dsv41 iq test: DS4_BENCH_WIN (window path / DSpark verify bench: n entries a group)
01220ed Niko1221 committed 27 days ago
metal: a one-Context allocator for the dsv41 engine, opt-in so the default path is untouched
15f1fe0 Niko1221 committed 27 days ago
metal: the first dsv41 host wrapper - compile, wrap, dispatch (and the one-Context invariant it exposed)
5f6d49e Niko1221 committed 27 days ago