Skip to content

Qwen3.8-Flash-Next on any consumer hardware: one-click install for Windows / Linux. Strata inference engine, OpenAI/Anthropic API on localhost, optional image input.

C++

dsv41: the store fill after a chunked prompt reaches the store's whole capacity, not only its allocated slots

Niko12210beae0bca6b5
diff --git a/src/dsv41/ds4_model.cu b/src/dsv41/ds4_model.cu
index b1d78f1ee..794877160 100644
--- a/src/dsv41/ds4_model.cu
+++ b/src/dsv41/ds4_model.cu
@@ -5379,7 +5379,7 @@ struct Model::Impl {
std::sort(hot.begin(), hot.end(), [](const auto& a, const auto& b) { return a.first > b.first; });
std::vector<std::pair<int, int>> list;
for (const auto& h : hot) {
- if (list.size() >= store->slots_allocated()) break;
+ if (list.size() >= store->slots_max()) break;
list.push_back(h.second);
}
const double ts = now_ms();