Distribute and run LLMs with a single file.
C++ cross-platformggufllama-cpplocal-ailocal-inferencelocal-llmopen-source-aisingle-file-executablespeech-to-text
Include ngl parameter in README.md (#267)
John Goering6d8790b84cbd
diff --git a/README.md b/README.mdindex 51a079dc..a8427315 100644--- a/README.md+++ b/README.md@@ -260,7 +260,7 @@ For Windows users, here's an example for the Mistral LLM:```shcurl -L -o llamafile.exe https://github.com/Mozilla-Ocho/llamafile/releases/download/0.6/llamafile-0.6curl -L -o mistral.gguf https://huggingface.co/TheBloke/Mistral-7B-Instruct-v0.1-GGUF/resolve/main/mistral-7b-instruct-v0.1.Q4_K_M.gguf-./llamafile.exe -m mistral.gguf+./llamafile.exe -m mistral.gguf -ngl 9999```Windows users may need to change `./llamafile.exe` to `.\llamafile.exe`