Distribute and run LLMs with a single file.
C++ cross-platformggufllama-cpplocal-ailocal-inferencelocal-llmopen-source-aisingle-file-executablespeech-to-text
Commits on main
revise README for clarity and easier onboarding for new users
da4673b Stephen Hood committed 2 years ago
Add single-client multi-prompt support to server
12f4319 Ziad Ben Hadj-Alouane committed 2 years ago