Distribute and run LLMs with a single file.
C++ cross-platformggufllama-cpplocal-ailocal-inferencelocal-llmopen-source-aisingle-file-executablespeech-to-text
Commits on main
Fix get_amd_offload_arch_flag so it will match offload-arch types having alphanumeric names (#368)
d5d13c4 rasmith committed 2 years ago
Improve markdown and syntax highlighting in server (#88)
dd49f26 Dominic Szablewski committed 2 years ago