Skip to content

Qwen3.8-Flash-Next on any consumer hardware: one-click install for Windows / Linux. Strata inference engine, OpenAI/Anthropic API on localhost, optional image input.

C++

dsv41 store zero-copy: clear the device's zc_tab entry when VRAM takes an expert over (a stale pointer into a reused slot made zc_stage copy another expert's blob into the plan: garbage, NaN routing, illegal access)

Niko1221624a226d13e7
diff --git a/src/dsv41/ds4_model.cu b/src/dsv41/ds4_model.cu
index bc29b69d8..29c2f48dd 100644
--- a/src/dsv41/ds4_model.cu
+++ b/src/dsv41/ds4_model.cu
@@ -5503,6 +5503,11 @@ struct Model::Impl {
l.slot[(size_t) sw.in] = l.spare_vram;
if (!l.zc.empty() && l.zc[(size_t) sw.in]) { // (VRAM's now: not the store's to compute any more)
l.zc[(size_t) sw.in] = 0;
+ if (l.zc_tab != nullptr) { // (the device's table too: its entry pointed into the slot the store now reuses - when `in` left VRAM later,
+ // zc_stage copied whatever lay there, another expert's blob, into the plan)
+ cudaSetDevice(devs[0].id);
+ cudaMemsetAsync(l.zc_tab + sw.in, 0, 8, devs[0].st);
+ }
store->unmark(l.il, sw.in);
}
if (l.nm == 1) set_vm(l, sw.in, l.spare_vram);