LLM inference in C/C++
C++ ggml
arg: Add LLAMA_ARG_API_KEY_FILE environment variable for --api-key-file (#23167)
Mikolaj Kucharski7fb1e70b5948
diff --git a/common/arg.cpp b/common/arg.cppindex bdc2e9eb4f..f6fdd4fa63 100644--- a/common/arg.cpp+++ b/common/arg.cpp@@ -2998,7 +2998,7 @@ common_params_context common_params_parser_init(common_params & params, llama_ex}key_file.close();}- ).set_examples({LLAMA_EXAMPLE_SERVER}));+ ).set_examples({LLAMA_EXAMPLE_SERVER}).set_env("LLAMA_ARG_API_KEY_FILE"));add_opt(common_arg({"--ssl-key-file"}, "FNAME","path to file a PEM-encoded SSL private key",diff --git a/tools/server/README.md b/tools/server/README.mdindex 0d20ced879..b975088e4a 100644--- a/tools/server/README.md+++ b/tools/server/README.md@@ -201,7 +201,7 @@ For the full list of features, please refer to [server's changelog](https://gith| `--embedding, --embeddings` | restrict to only support embedding use case; use only with dedicated embedding models (default: disabled)<br/>(env: LLAMA_ARG_EMBEDDINGS) || `--rerank, --reranking` | enable reranking endpoint on server (default: disabled)<br/>(env: LLAMA_ARG_RERANKING) || `--api-key KEY` | API key to use for authentication, multiple keys can be provided as a comma-separated list (default: none)<br/>(env: LLAMA_API_KEY) |-| `--api-key-file FNAME` | path to file containing API keys (default: none) |+| `--api-key-file FNAME` | path to file containing API keys, one per line (default: none)<br/>(env: LLAMA_ARG_API_KEY_FILE) || `--ssl-key-file FNAME` | path to file a PEM-encoded SSL private key<br/>(env: LLAMA_ARG_SSL_KEY_FILE) || `--ssl-cert-file FNAME` | path to file a PEM-encoded SSL certificate<br/>(env: LLAMA_ARG_SSL_CERT_FILE) || `--chat-template-kwargs STRING` | sets additional params for the json template parser, must be a valid json object string, e.g. '{"key1":"value1","key2":"value2"}'<br/>(env: LLAMA_ARG_CHAT_TEMPLATE_KWARGS) |