Distribute and run LLMs with a single file.
C++ cross-platformggufllama-cpplocal-ailocal-inferencelocal-llmopen-source-aisingle-file-executablespeech-to-text
Commits on main
Fix handling of characters that span multiple tokens when streaming
77cecbe Vladimir Zorin committed 2 years ago
Improve markdown and syntax highlighting in server (#88)
c236a71 Dominic Szablewski committed 2 years ago