Qwen3.8-Flash-Next on any consumer hardware: one-click install for Windows / Linux. Strata inference engine, OpenAI/Anthropic API on localhost, optional image input.
C++
APR port: count the prompt path's rotated-input buffer in moe_set_bytes
Laurent Zuijdwijkf4abf43154e0
diff --git a/src/prefill/prefill.cpp b/src/prefill/prefill.cppindex 3f6ec14db..8d14fe46c 100644--- a/src/prefill/prefill.cpp+++ b/src/prefill/prefill.cpp@@ -1206,6 +1206,9 @@ uint64_t moe_set_bytes(size_t T, int64_t n_expert, bool fused) {a.take<uint8_t>(mb.hq, ok);a.take<float>(T * K, ok); a.take<float>(T * K, ok); a.take<float>(MMQ_GROUP * 4, ok);a.take<float>(T * K, ok);+ // APR: the rotated copy of `mixed` for the MMQ path (carve's m.Xr) - it must be counted here too, or the MoE+ // set outgrows the region `carve` sizes from this, and `init` fails with "do not fit" at any chunk+ if (strata::kernels::cpu::hadamard_spec().any()) a.take<float>(T * N, ok);}return a.used;}