Skip to content

LLM inference in C/C++

C++ ggml
113 B
Raw Blame

This is a swift clone of examples/batched.

$ ./llama-batched-swift MODEL_PATH [PROMPT] [PARALLEL]