Skip to content

Get up and running with Kimi, GLM, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.

runner: Set windows above normal priority (#6905)

Daniel Hiltgendbba73469d98
diff --git a/llm/llm_windows.go b/llm/llm_windows.go
index 74a735c21..915355a25 100644
--- a/llm/llm_windows.go
+++ b/llm/llm_windows.go
@@ -4,7 +4,10 @@ import (
"syscall"
)
-const CREATE_DEFAULT_ERROR_MODE = 0x04000000
+const (
+ CREATE_DEFAULT_ERROR_MODE = 0x04000000
+ ABOVE_NORMAL_PRIORITY_CLASS = 0x00008000
+)
var LlamaServerSysProcAttr = &syscall.SysProcAttr{
// Wire up the default error handling logic If for some reason a DLL is
@@ -12,5 +15,8 @@ var LlamaServerSysProcAttr = &syscall.SysProcAttr{
// the user can either fix their PATH, or report a bug. Without this
// setting, the process exits immediately with a generic exit status but no
// way to (easily) figure out what the actual missing DLL was.
- CreationFlags: CREATE_DEFAULT_ERROR_MODE,
+ //
+ // Setting Above Normal priority class ensures when running as a "background service"
+ // with "programs" given best priority, we aren't starved of cpu cycles
+ CreationFlags: CREATE_DEFAULT_ERROR_MODE | ABOVE_NORMAL_PRIORITY_CLASS,
}