LLM inference in C/C++
C++ ggml
server : clarify comment in eval_llama_cmpl_schema [no ci] [no release] (#26720)
Daniel Bevenius9ba73fd1f5bc
diff --git a/tools/server/server-schema.cpp b/tools/server/server-schema.cppindex 5cef3908fa..5d7fa6ae6e 100644--- a/tools/server/server-schema.cpp+++ b/tools/server/server-schema.cpp@@ -519,7 +519,7 @@ task_params eval_llama_cmpl_schema(const json & data) {task_params params;- // Sampling parameter defaults are loaded from the global server context (but individual requests can still them)+ // Sampling parameter defaults are loaded from the global server context (but individual requests can still override them)params.sampling = params_base.sampling;params.speculative = params_base.speculative;params.n_keep = params_base.n_keep;