Distribute and run LLMs with a single file.
C++ cross-platformggufllama-cpplocal-ailocal-inferencelocal-llmopen-source-aisingle-file-executablespeech-to-text
Table of contents
Getting Started
Using llamafile
- Running a llamafile
- API server
- Built-in local tools
- Agentfile
- Creating llamafiles
- Source installation
- Building DLLs