Skip to content

Distribute and run LLMs with a single file.

Commits on main

Introduce --silent-prompt flag to main
Justine Tunney committed 2 years ago
28d3160
Make server.o build 2x faster
Justine Tunney committed 2 years ago
bc26708
Update with SVG logo
Stephen Hood committed 2 years ago
81d20df
add SVG logo
Stephen Hood committed 2 years ago
5f69bb9
Add star-history as of 12/3/2023
Stephen Hood committed 2 years ago
8b44754
add minimum hardware requirements
Stephen Hood committed 2 years ago
cc43e1d
Update grammar-parser.cpp (#48)
Ikko Eltociear Ashimine committed 2 years ago
a7cc180
Make Q2/Q3 weights go 2x faster on AMD64 AVX2 CPUs
Justine Tunney committed 2 years ago
36b103e
Add --version flag
Justine Tunney committed 2 years ago
d4e2388
Add support for replacing zip files to zipalign
Justine Tunney committed 2 years ago
7b2fbcb
Add tool for checking alignment of PKZIP assets
Justine Tunney committed 2 years ago
1fbc21f
Disable pledge on systems with GPUs
Justine Tunney committed 2 years ago
61944b5
Make OpenAI API `stop` field optional (#36)
Ed Lee committed 2 years ago
e8c92bc
Log cuda build command to stderr
Justine Tunney committed 2 years ago
ccc377e
Update license link for LLaVA
Stephen Hood committed 2 years ago
68f5622
Add LLaVA back to README table
Justine Tunney committed 2 years ago
05dfab1
da4673b
Add runtime dispatching for Q5 weights
Justine Tunney committed 2 years ago
73ee0b1
Release llamafile v0.2.1
Justine Tunney committed 2 years ago
57cc1f4
Release llamafile v0.2
Justine Tunney committed 2 years ago
d05e063
Upgrade to cosmocc v3.1.2
Justine Tunney committed 2 years ago
830d917
Make server --path work with pledge() security
Justine Tunney committed 2 years ago
e85cc5a
Update llama.cpp/README.llamafile
Justine Tunney committed 2 years ago
57573c5
Add --log-disable flag to server
Ziad Ben Hadj-Alouane committed 2 years ago
c64989a
Add single-client multi-prompt support to server
Ziad Ben Hadj-Alouane committed 2 years ago
12f4319
Fix typical sampling (#4261)
tarcey committed 2 years ago
90fa20f
`reserve` space in `decode_utf8`
Marcus Dunn committed 2 years ago
e574488
Fix support for old Intel CPUs
Justine Tunney committed 2 years ago
95703b6
Fix typo
Justine Tunney committed 2 years ago
e8c66f9
Add gotchas to README mentioning WINE and WSL
Justine Tunney committed 2 years ago
3702c05