Skip to content

Distribute and run LLMs with a single file.

Commits on main

Fix logic around <img> prompts
Justine Tunney committed 2 years ago
85f9c74
Synchronize with llama.cpp
Justine Tunney committed 2 years ago
c0208c1
Use Kahan summation in tinyBLAS
Justine Tunney committed 2 years ago
ab7b75d
Fix build on recent Ubuntu
Justine Tunney committed 2 years ago
725aa3a
Clean up some code
Justine Tunney committed 2 years ago
4ab9d72
Improve accuracy and performance of tinyBLAS
Justine Tunney committed 2 years ago
9c53c27
Make portability fixes
Justine Tunney committed 2 years ago
3913d88
Use warp tiling for tinyblasGemmEx()
Justine Tunney committed 2 years ago
cdc09c3
Port tinyBLAS code to MSVC
Justine Tunney committed 2 years ago
f338952
Write more testing code
Justine Tunney committed 2 years ago
1aee87f
Fix tinyBLAS accuracy
Justine Tunney committed 2 years ago
31330d0
Run clang-format on llamafile directory
Justine Tunney committed 2 years ago
c908b0f
Synchronize with llama.cpp upstream
Justine Tunney committed 2 years ago
8c4d7af
Upgrade to cosmocc 3.3.2
Justine Tunney committed 2 years ago
86ee0a8
Upgrade to cosmocc v3.3.1
Justine Tunney committed 2 years ago
c011235
Don't show loading progress with --log_disable
Justine Tunney committed 2 years ago
6e47b0b
Cherry pick gemma fix from upstream
Justine Tunney committed 2 years ago
b2f240e
Synchronize with llama.cpp upstream
Justine Tunney committed 2 years ago
5447ca8
Fixup commit for 84490a7bca53 (#265)
Gautham committed 2 years ago
725eca9
Upgrade to Cosmopolitan 3.3
Justine Tunney committed 2 years ago
5b109da
Include ngl parameter in README.md (#267)
John Goering committed 2 years ago
6d8790b
Have less checks in check_args (#241)
Gautham committed 2 years ago
84490a7
Add sandboxing for the server on Apple Silicon Macs (#261)
Haik Aftandilian committed 2 years ago
d8e58ed
Always enable --embedding mode on server
Justine Tunney committed 2 years ago
97eca06
Improve prompt eval time on x86 CPUs
Justine Tunney committed 2 years ago
9f5002a
Remove -fopenmp flag
Justine Tunney committed 2 years ago
176f089
Make clickable HTTP server links easier to see
Justine Tunney committed 2 years ago
7a8d5ee
Make AVX mandatory and support VNNI
Justine Tunney committed 2 years ago
cdd7458
Fix issue with recent llamafile-convert change
Justine Tunney committed 2 years ago
4fd603e