Distribute and run LLMs with a single file.
C++ cross-platformggufllama-cpplocal-ailocal-inferencelocal-llmopen-source-aisingle-file-executablespeech-to-text
Commits on main
Use LLAMAFILE_GPU_ERROR value -2 instead of -1 (#291)
70c7863 Antonis Makropoulos committed 2 years ago