Qwen3.8-Flash-Next on any consumer hardware: one-click install for Windows / Linux. Strata inference engine, OpenAI/Anthropic API on localhost, optional image input.
C++
dsv41: the store fill after a chunked prompt reaches the store's whole capacity, not only its allocated slots
Niko12210beae0bca6b5
diff --git a/src/dsv41/ds4_model.cu b/src/dsv41/ds4_model.cuindex b1d78f1ee..794877160 100644--- a/src/dsv41/ds4_model.cu+++ b/src/dsv41/ds4_model.cu@@ -5379,7 +5379,7 @@ struct Model::Impl {std::sort(hot.begin(), hot.end(), [](const auto& a, const auto& b) { return a.first > b.first; });std::vector<std::pair<int, int>> list;for (const auto& h : hot) {- if (list.size() >= store->slots_allocated()) break;+ if (list.size() >= store->slots_max()) break;list.push_back(h.second);}const double ts = now_ms();