Qwen3.8-Flash-Next on any consumer hardware: one-click install for Windows / Linux. Strata inference engine, OpenAI/Anthropic API on localhost, optional image input.
C++
dsv41: store arena pre-grown by default on Linux when the GPU maps it
Niko1221c35710e388bd
diff --git a/src/dsv41/ds4_store.hpp b/src/dsv41/ds4_store.hppindex 643ef376d..aa0d2b8d4 100644--- a/src/dsv41/ds4_store.hpp+++ b/src/dsv41/ds4_store.hpp@@ -93,10 +93,15 @@ public:}io_.reset(new IoQueue(std::max(1, c.threads)));grow(); // (the first chunk now: whether the GPU can map it is known from the start)- // DS4_STORE_PREGROW=1: the whole arena now. cuMemHostRegister (the GPU mapping of a chunk) taken while a kernel of+ // DS4_STORE_PREGROW=1 (default on Linux with the GPU mapping, =0 off): the whole arena now. cuMemHostRegister (the GPU mapping of a chunk) taken while a kernel of// the decode is running waited on it for good on Linux (H100, driver 580): registering all chunks before the first// kernel avoids it- if (std::getenv("DS4_STORE_PREGROW") != nullptr)+#if defined(__linux__)+ const bool pregrow = cfg_.map_chunk && !(std::getenv("DS4_STORE_PREGROW") != nullptr && std::atoi(std::getenv("DS4_STORE_PREGROW")) == 0); // (Linux: on with the GPU mapping)+#else+ const bool pregrow = std::getenv("DS4_STORE_PREGROW") != nullptr && std::atoi(std::getenv("DS4_STORE_PREGROW")) != 0;+#endif+ if (pregrow)while (grow()) {}return true;