Distribute and run LLMs with a single file.
C++ cross-platformggufllama-cpplocal-ailocal-inferencelocal-llmopen-source-aisingle-file-executablespeech-to-text
Commits on main
Optimized matrix multiplications for i-quants on __aarch64__ (#464)
c38feb4 Kawrakow committed 2 years ago
Performance improvements on Arm for legacy and k-quants (#453)
293a528 Kawrakow committed 2 years ago
github: delete question in favor of link to discussion [no ci] (#457)
73088c3 Brian committed 2 years ago