Skip to content

Qwen3.8-Flash-Next on any consumer hardware: one-click install for Windows / Linux. Strata inference engine, OpenAI/Anthropic API on localhost, optional image input.

C++

dsv41: DS4_STORE_PREGROW=1 (map the whole store arena before the first kernel; cuMemHostRegister mid-decode hangs on Linux)

Niko1221f7d707284124
diff --git a/src/dsv41/ds4_store.hpp b/src/dsv41/ds4_store.hpp
index 3c7b923a7..643ef376d 100644
--- a/src/dsv41/ds4_store.hpp
+++ b/src/dsv41/ds4_store.hpp
@@ -93,6 +93,12 @@ public:
}
io_.reset(new IoQueue(std::max(1, c.threads)));
grow(); // (the first chunk now: whether the GPU can map it is known from the start)
+ // DS4_STORE_PREGROW=1: the whole arena now. cuMemHostRegister (the GPU mapping of a chunk) taken while a kernel of
+ // the decode is running waited on it for good on Linux (H100, driver 580): registering all chunks before the first
+ // kernel avoids it
+ if (std::getenv("DS4_STORE_PREGROW") != nullptr)
+ while (grow()) {
+ }
return true;
}
~ExpertStore() {