Distribute and run LLMs with a single file.
C++ cross-platformggufllama-cpplocal-ailocal-inferencelocal-llmopen-source-aisingle-file-executablespeech-to-text
Release llamafile v0.2.1
Justine Tunney57cc1f476a97
diff --git a/README.md b/README.mdindex c3d221d7..94a8854e 100644--- a/README.md+++ b/README.md@@ -53,7 +53,7 @@ weights included) from our releases page, or directly in your terminalor command prompt. This is mandatory currently on Windows.```sh-curl -L https://github.com/Mozilla-Ocho/llamafile/releases/download/0.2/llamafile-server-0.2 >llamafile+curl -L https://github.com/Mozilla-Ocho/llamafile/releases/download/0.2.1/llamafile-server-0.2.1 >llamafilechmod +x llamafile./llamafile --help./llamafile -m ~/weights/foo.gguf@@ -89,7 +89,7 @@ Here's an example of how to do that. Let's say you want to try Mistral.In that case you can open PowerShell and run these commands:```-curl -o llamafile.exe https://github.com/Mozilla-Ocho/llamafile/releases/download/0.2/llamafile-server-0.2+curl -o llamafile.exe https://github.com/Mozilla-Ocho/llamafile/releases/download/0.2.1/llamafile-server-0.2.1curl -o mistral.gguf https://huggingface.co/TheBloke/Mistral-7B-Instruct-v0.1-GGUF/resolve/main/mistral-7b-instruct-v0.1.Q4_K_M.gguf.\llamafile.exe -m mistral.gguf```@@ -132,7 +132,7 @@ can download the latest release and add it to your path.```shmkdir -p cosmocccd cosmocc-curl -L https://github.com/jart/cosmopolitan/releases/download/3.1.2/cosmocc-3.1.2.zip >cosmocc.zip+curl -L https://github.com/jart/cosmopolitan/releases/download/3.1.3/cosmocc-3.1.3.zip >cosmocc.zipunzip cosmocc.zipcd ..export PATH="$PWD/cosmocc/bin:$PATH"