Skip to content

Qwen3.8-Flash-Next on any consumer hardware: one-click install for Windows / Linux. Strata inference engine, OpenAI/Anthropic API on localhost, optional image input.

C++

149: STRATA_COLD_OVERLAP=4 (zero-copy without the overlap); no residency query for RAM-resident experts

Niko12212044864dba32
diff --git a/src/core/expert_source.cpp b/src/core/expert_source.cpp
index a97626a66..3f16b2bc1 100644
--- a/src/core/expert_source.cpp
+++ b/src/core/expert_source.cpp
@@ -1637,6 +1637,9 @@ void FileExpertSource::claim_todo(int64_t layer, const int64_t* experts, int64_t
for (int64_t i = 0; i < n; ++i) {
const int64_t e = experts[i];
if (e < 0 || e >= n_expert_) continue;
+ const size_t index = (size_t) layer * (size_t) n_expert_ + (size_t) e;
+ if (complement_ready_ && resident_blob(index) != nullptr) continue; // in the RAM copy: no residency query
+ if (!override_.empty() && override_[index] != nullptr) continue;
uint64_t total = 0;
const uint64_t c = cached_bytes(layer, e, total, true);
zc_ok[(size_t) i] = total > 0 && c >= total ? 1 : 0; // no residency query (not Linux): never