Skip to content

LLM inference in C/C++

C++ ggml

llama-bench : fix docs (#29464)

Marlon Paz79625e056ee4
diff --git a/tools/llama-bench/README.md b/tools/llama-bench/README.md
index 512a2c0248..82e8461080 100644
--- a/tools/llama-bench/README.md
+++ b/tools/llama-bench/README.md
@@ -67,9 +67,9 @@ test parameters:
-nkvo, --no-kv-offload <0|1> (default: 0)
-fa, --flash-attn <on|off|auto> (default: auto)
-dev, --device <dev0/dev1/...> (default: auto)
+ -lm, --load-mode <auto|none|mmap|mlock|mmap+mlock|dio>
+ (default: auto)
-lzm, --lazy-mode <on|auto|off> (default: auto)
- -mmp, --mmap <0|1> (DEPRECATED IN FAVOUR OF --load-mode)
- -dio, --direct-io <0|1> (DEPRECATED IN FAVOUR OF --load-mode)
-embd, --embeddings <0|1> (default: 0)
-ts, --tensor-split <ts0/ts1/..> (default: 0)
-ot --override-tensor <tensor name pattern>=<buffer type>;...