Skip to content

Distribute and run LLMs with a single file.

Commits on main

Use LLAMAFILE_GPU_ERROR value -2 instead of -1 (#291)
Antonis Makropoulos committed 2 years ago
70c7863
Perform some marginal optimizations
Justine Tunney committed 2 years ago
5625b4b
Restore BF16 support
Justine Tunney committed 2 years ago
b1c3cdd
Sync with upstream
Justine Tunney committed 2 years ago
3a94f08
Fix 2 embeddings-related issues in server.cpp (#324)
Kate Silverstein committed 2 years ago
956fb58
Clean up more code
Justine Tunney committed 2 years ago
e583f63
Update README.md (#316)
MrLinks75 committed 2 years ago
cb92b32
Update README.md (#315)
Ikko Eltociear Ashimine committed 2 years ago
56a9d76
Clean up kernel code
Justine Tunney committed 2 years ago
aba495e
Clamp out of range values in K quantizer
Justine Tunney committed 2 years ago
ef0307e
Update to latest q5_k quantization code
Justine Tunney committed 2 years ago
a8b0b15
Add Iwan Kawrakow to copyright
Justine Tunney committed 2 years ago
9fc233c
Clean up some code
Justine Tunney committed 2 years ago
0b3f3bd
Change file format magic number for bf16
Justine Tunney committed 2 years ago
257491d
Release llamafile v0.7
Justine Tunney committed 2 years ago
c7780c4
Fix server initialization order
Justine Tunney committed 2 years ago
ce2e848
Add support for bfloat16
Justine Tunney committed 2 years ago
6dbc507
Do some code cleanup
Justine Tunney committed 2 years ago
538985d
Count number of cores correctly on Alderlake CPUs
Justine Tunney committed 2 years ago
2ba0afd
Improve process loading time
Justine Tunney committed 2 years ago
73810a4
Improve vector dot accuracy on cpu
Justine Tunney committed 2 years ago
1219c9f
Add missing AT_HWCAP test to unbreak RPI4
Justine Tunney committed 2 years ago
e38de1d
Add armv8.2-a+dotprod kernel for q8_0
Justine Tunney committed 2 years ago
6d8fa43
Remove bad assertion
Justine Tunney committed 2 years ago
164f79b
Boost reading speed on Raspberry Pi 5
Justine Tunney committed 2 years ago
1fecf91
Do more post synchronization cleanup
Justine Tunney committed 2 years ago
5f58779
Add support for AVX512
Justine Tunney committed 2 years ago
e629e75
Revert recent upstream developments on server
Justine Tunney committed 2 years ago
8ff1283
Change build strategy for CPU optimizations
Justine Tunney committed 2 years ago
47b4f2f
Revise previous commit
Justine Tunney committed 2 years ago
616f0a5