LLM inference in C/C++
C++ ggml
llama-bench : fix docs (#29464)
Marlon Paz79625e056ee4
diff --git a/tools/llama-bench/README.md b/tools/llama-bench/README.mdindex 512a2c0248..82e8461080 100644--- a/tools/llama-bench/README.md+++ b/tools/llama-bench/README.md@@ -67,9 +67,9 @@ test parameters:-nkvo, --no-kv-offload <0|1> (default: 0)-fa, --flash-attn <on|off|auto> (default: auto)-dev, --device <dev0/dev1/...> (default: auto)+ -lm, --load-mode <auto|none|mmap|mlock|mmap+mlock|dio>+ (default: auto)-lzm, --lazy-mode <on|auto|off> (default: auto)- -mmp, --mmap <0|1> (DEPRECATED IN FAVOUR OF --load-mode)- -dio, --direct-io <0|1> (DEPRECATED IN FAVOUR OF --load-mode)-embd, --embeddings <0|1> (default: 0)-ts, --tensor-split <ts0/ts1/..> (default: 0)-ot --override-tensor <tensor name pattern>=<buffer type>;...