Skip to content

Distribute and run LLMs with a single file.

Commits on main

Introduce pledge() / seccomp security to llama.cpp
Justine Tunney committed 2 years ago
8f21460
Fix PowerShell curl command in README
Justine Tunney committed 2 years ago
c005c56
Add Windows PowerShell example to README
Justine Tunney committed 2 years ago
95bb1e9
Mention CrowdStrike in README
Justine Tunney committed 2 years ago
dc4cb40
Look for GGML DSO *before* looking for NVCC
Justine Tunney committed 2 years ago
481b6a5
Check for i/o errors in httplib read_file()
Justine Tunney committed 2 years ago
41f243e
711344b
Add appropriate chmod to README instructions
Justine Tunney committed 2 years ago
e024d90
Fix typo in README.md (#8)
Matthew Bramer committed 2 years ago
f861232
Recompute README model sizes in gibibytes
Justine Tunney committed 2 years ago
8cb7c88
Better document how we've changed llama.cpp
Justine Tunney committed 2 years ago
bdd066d
Add OpenAI API compatibility to server
Georgi Gerganov committed 2 years ago
401dd08
Fix uninitialized variables in server
Haohui Mai committed 2 years ago
ed87fdb
Avoid CUDA assertion error with some models
Andrew Godfrey committed 2 years ago
c5d35b0
Fix LLaVA regression for square images
M. Yusuf Sarıgöz committed 2 years ago
c373b5d
Fix server crash when prompt exceeds context size
Alexey Parfenov committed 2 years ago
176e54f
Cherry pick StableLM support from llama.cpp
Justine Tunney committed 2 years ago
865462f
Fix documentation on Windows 4GB exe size limit
Justine Tunney committed 2 years ago
81c6ad3
Fix example prompt arguments
Justine Tunney committed 2 years ago
c001c89
Add link to blog post
Justine Tunney committed 2 years ago
e95ec98
Clarify Build Instructions in README.md
Justine Tunney committed 2 years ago
ea1e825
Improve README.md
Justine Tunney committed 2 years ago
37789c1
Add missing O_CLOEXEC
Justine Tunney committed 2 years ago
038dc40
Fix server so it can open browser tab
Justine Tunney committed 2 years ago
e5c2315
Upgrade to cosmocc v3.1.1
Justine Tunney committed 2 years ago
9b8936f
Add links to example wrapped weights
Stephen Hood committed 2 years ago
638d747
update curl command for downloading cosmocc
Stephen Hood committed 3 years ago
12e17bd
Add alpha to llamafile.png
Justine Tunney committed 3 years ago
c29aec6
update curl to correctly download binary release
Stephen Hood committed 3 years ago
3d6f36b
fix logo
Stephen Hood committed 3 years ago
c34a06c