Qwen3.8-Flash-Next on any consumer hardware: one-click install for Windows / Linux. Strata inference engine, OpenAI/Anthropic API on localhost, optional image input.
C++
dsv41: DS4_STORE_PREGROW=1 (map the whole store arena before the first kernel; cuMemHostRegister mid-decode hangs on Linux)
Niko1221f7d707284124
diff --git a/src/dsv41/ds4_store.hpp b/src/dsv41/ds4_store.hppindex 3c7b923a7..643ef376d 100644--- a/src/dsv41/ds4_store.hpp+++ b/src/dsv41/ds4_store.hpp@@ -93,6 +93,12 @@ public:}io_.reset(new IoQueue(std::max(1, c.threads)));grow(); // (the first chunk now: whether the GPU can map it is known from the start)+ // DS4_STORE_PREGROW=1: the whole arena now. cuMemHostRegister (the GPU mapping of a chunk) taken while a kernel of+ // the decode is running waited on it for good on Linux (H100, driver 580): registering all chunks before the first+ // kernel avoids it+ if (std::getenv("DS4_STORE_PREGROW") != nullptr)+ while (grow()) {+ }return true;}~ExpertStore() {