Qwen3.8-Flash-Next on any consumer hardware: one-click install for Windows / Linux. Strata inference engine, OpenAI/Anthropic API on localhost, optional image input.
C++
Commits on main
Fix #3613 #3467: the Terminal/Control bundle ships tools/calibrate.py; a setup crash now says what it was
2a22daa Niko1221 committed 29 days ago
Fix #3670: certifi 2026.10.19 (drops the emSign ECC Root CA - G3 root) in requirements.txt and the three runtime locks
27a5707 Niko1221 committed 29 days ago
Fix #3683: the test start no longer waits out its 10 minutes when a Windows venv launcher sits above the server
72d0bf6 Niko1221 committed 29 days ago
docs: the Strix Halo 8-bit hyper-connection line goes into a new release-notes-0.2.3.md (0.2.2 is released)
e7ded66 Niko1221 committed 29 days ago
dflash2: --draft-conf (window cut by the selector's cumulative probability), drafter streams at high priority on CUDA
3ae2123 Niko1221 committed 29 days ago
hip: 8-bit hyper-connection weights (STRATA_HC_Q8) on by default on gfx1151, STRATA_HC_Q8=0 keeps the bf16 read; one start-up line; docs and 0.2.2 release note with the KL table and the CPU-vs-GPU rounding baseline
6d4874a Niko1221 committed 29 days ago
spec: the cost-aware window keeps one row-cost table per context length (< 6K, < 24K, longer), seedable per bucket
b1ebc3d Niko1221 committed 29 days ago
dsv41: pack_gguf --override-experts (mixed-bit packs from two requantized sets); stageB tooling
5e52cf5 Niko1221 committed 29 days ago
dflash2: a verify window whose graph runs out of memory narrows the window instead of failing; --draft-cap, 5 by default on Strix Halo, a plain line on 12 GB NVIDIA
ff9ca03 Niko1221 committed 29 days ago
dsv41: dense K-quant GEMV (Q5_K/Q6_K) + dense_requant, ggml-type CPU lane, imatrix builder, requant fixes (C0 experiments)
5278ba0 Niko1221 committed 29 days ago
gr: fold the hyper-connection inject and gate/mean into their neighbours
aec327e Niko1221 committed 29 days ago
wip: gfx1151 takes mode 8 gate/up (LDS, fused SwiGLU + q8_1) and the CUDA-layout down for IQ4_NL
9fe2ad3 Niko1221 committed 29 days ago
verify: the DFlash2 tap kernel only where the DFlash2 sources are built (Metal and SYCL keep the per-row dump path)
ba6966d Niko1221 committed 29 days ago
dflash2: drop the cache-touch kernel (no gain), wait-commit measurement switch
6f83fe2 Niko1221 committed 29 days ago
spec: faster start-up adaptation of the expert tier in speculative runs (swap every 2 verify rounds for the first 200, then the normal interval); default on sm_86 only, STRATA_SPEC_ADAPT_EVERY / STRATA_SPEC_ADAPT_WARM set it elsewhere, an explicit --adapt-every is kept
2ccf57e Niko1221 committed 29 days ago
dflash2: fused conv+residual+norm+quant, q/k norm+rope, K/V ring write and attention-output quantization; stage skip switches and small benches
8979959 Niko1221 committed 29 days ago
spec: cost-aware window: the first round of a width is replaced by the guess from the other widths, a running mean for the first samples
48ec4a5 Niko1221 committed 29 days ago
spec: with STRATA_SPEC_COST a round far above the known cost of its width (the first use captures a graph) counts as a tenth of a sample
e0d79b0 Niko1221 committed 29 days ago
spec: STRATA_SPEC_COST_TABLE seeds the row costs (a per-card table), the CLI prints the learned table at the end
d45cd9d Niko1221 committed 29 days ago
dflash2: tiled Q8 GEMM, fused quantizers, head-major K/V ring with a prefetching attention, forked context update, PLE read-ahead, benches
5bc7f8c Niko1221 committed 29 days ago
native_expert_bench: BENCH_CAP sizes the launch for more possible groups than real ones (what the empty block rows of a verify window cost); bench only
b7d5ea2 Niko1221 committed 29 days ago
spec: cost-aware chain rule keeps the best width seen and looks one or two drafts ahead (the row cost is not convex); unmeasured widths are probed a few times
d232721 Niko1221 committed 29 days ago
spec: STRATA_SPEC_COST keeps an MTP draft only while the next row pays at the measured row cost (step-by-step chain rule in MtpDrafter, DraftPolicy::keep_draft)
5f49ec4 Niko1221 committed 29 days ago
dsv41: DS4_TRACE routing trace (env), routestats / budget model scripts live in phaseA-tests
54f8131 Niko1221 committed 29 days ago
DFlash2 drafter for Qwen3.8-Flash-Next: Q8_0 pack tool, GPU forward (conv, K/V ring, windowed attention, top-16 selector), permanent verify/prefill taps, --draft dflash2 --draft-model (opt-in, MTP stays the fallback)
7f97c35 Niko1221 committed 29 days ago