Skip to content

LLM inference in C/C++

C++ ggml
185 B
Raw Blame
---
base_model:
- {base_model}
---
# {model_name} GGUF

Recommended way to run this model:

```sh
llama-server -hf {namespace}/{model_name}-GGUF
```

Then, access http://localhost:9931