Get up and running with Kimi, GLM, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.
Harden unload for empty runners
Daniel Hiltgen48702dd14936
diff --git a/server/sched.go b/server/sched.goindex 6bf5eb1fc..9eb4430e5 100644--- a/server/sched.go+++ b/server/sched.go@@ -588,6 +588,10 @@ func (s *Scheduler) findRunnerToUnload() *runnerRef {runnerList = append(runnerList, r)}s.loadedMu.Unlock()+ if len(runnerList) == 0 {+ slog.Debug("no loaded runner to unload")+ return nil+ }// In the future we can enhance the algorithm to be smarter about picking the optimal runner to unload// e.g., if we have multiple options, will one make room for the request?