Skip to content

Distribute and run LLMs with a single file.

Commits on main

Improve performance
Justine Tunney committed 2 years ago
d377ae9
Reduce rounding errors by 10x
Justine Tunney committed 2 years ago
cb817f5
Release llamafile v0.8.12
Justine Tunney committed 2 years ago
a73ea13
Introduce --no-warmup flag
Justine Tunney committed 2 years ago
1839bfa
Upgrade to Cosmopolitan v3.6.2
Justine Tunney committed 2 years ago
f40facc
Fix build determinism issue
Justine Tunney committed 2 years ago
fdd5d84
Update llamafile version in README
Justine Tunney committed 2 years ago
3e220e7
Make zipalign and slicehf gentler on system
Justine Tunney committed 2 years ago
909f791
Add link to OLMo-7B in README
Stephen Hood committed 2 years ago
dd10455
Fix code compatibility issues
Justine Tunney committed 2 years ago
867c752
Release llamafile v0.8.11
Justine Tunney committed 2 years ago
109e926
Add smaug-bpe tokenizer
Justine Tunney committed 2 years ago
7469a23
Release llamafile v0.8.10
Justine Tunney committed 2 years ago
f7c6ef4
Upgrade to Cosmopolitan v3.5.9
Justine Tunney committed 2 years ago
115315c
Supports SmolLM (#495)
Jason Stillerman committed 2 years ago
cc30400
Restore support for non-AVX microprocessors
Justine Tunney committed 2 years ago
a674cfb
Add more WSL help to README
Justine Tunney committed 2 years ago
e718463
Fix CUDA compile warnings and errors
Justine Tunney committed 2 years ago
4a4c065
Avoid crashing with BF16 on Apple Metal
Justine Tunney committed 2 years ago
82f845c
Update README.md (#480)
Greg Schwartz committed 2 years ago
0c76e14
Upgrade to Cosmopolitan v3.5.8
Justine Tunney committed 2 years ago
13cf96b
Improve build configuration
Justine Tunney committed 2 years ago
555fb80
Add missing ctype.h includes
Justine Tunney committed 2 years ago
5a15956
Fix core manager cancelation behavior
Justine Tunney committed 2 years ago
f008783
Let SIGQUIT produce per-thread backtraces
Justine Tunney committed 2 years ago
323f50a
Use semaphore to limit GGML worker threads
Justine Tunney committed 2 years ago
15d7fba
Upgrade to Cosmopolitan v3.5.7
Justine Tunney committed 2 years ago
04edc82
Upgrade to Cosmopolitan v3.5.6
Justine Tunney committed 2 years ago
3ec19d0
Write documentation for new server
Justine Tunney committed 2 years ago
73b1836
Make stack overflows recoverable in new server
Justine Tunney committed 2 years ago
7f099cd