Skip to content

Distribute and run LLMs with a single file.

Commits on main

Clean up more small issues
Justine Tunney committed 2 years ago
7be970a
Fix download-cosmocc.sh on Mac (#177)
Jōshin committed 2 years ago
8d5e91f
Clean up the GPU support code
Justine Tunney committed 2 years ago
ef10913
Restore MSVC compatibility
Justine Tunney committed 2 years ago
0d10a33
Fix support for multiple GPUs
Justine Tunney committed 2 years ago
4616816
Make CLIP GPU acceleration work on UNIX / Windows
Justine Tunney committed 2 years ago
20d5f46
Upgrade to cosmocc v3.2.1
Justine Tunney committed 2 years ago
2b1fef9
Remove -main from llamafile names
Justine Tunney committed 2 years ago
a6d041a
Release llamafile v0.5
Justine Tunney committed 2 years ago
ef83e2b
Fix llava filename generation example in manual
Justine Tunney committed 2 years ago
3359728
Make default thread count capped at 12 maximum
Justine Tunney committed 2 years ago
7843183
Don't use ggml-backend on non-Apple platforms
Justine Tunney committed 2 years ago
922c4f1
Make --log-disable work better
Justine Tunney committed 2 years ago
7d23bc9
Restore Apple Metal GPU support
Justine Tunney committed 2 years ago
912e616
Sync with llama.cpp upstream
Justine Tunney committed 2 years ago
2e276a1
Fix quants for AARCH64 CPU inference
Justine Tunney committed 2 years ago
dadb505
Make JSON server crashes more informative
Justine Tunney committed 2 years ago
dd4c9d7
Mention that lower perplexity is better
Justine Tunney committed 2 years ago
82f28fe
Add example using llamafile-perplexity to manual
Justine Tunney committed 2 years ago
9e60f5c
Embed man page into --help flag of each program
Justine Tunney committed 2 years ago
156f0a6
Upgrade to cosmocc 3.2
Justine Tunney committed 2 years ago
ce4aac6
Avoid activating GPU when we can't use the GPU
Justine Tunney committed 2 years ago
01b9aaf
Make --log-disable work a bit better
Justine Tunney committed 2 years ago
50bdf69
Make --nocompile flag work as intended
Justine Tunney committed 2 years ago
474b44f
Reduce BM/BN/BK to 64/32/64 to 48/12/48
Justine Tunney committed 2 years ago
d7cbaf7
Make some small fixes
Justine Tunney committed 2 years ago
190f96f
Regenerate manual
Justine Tunney committed 2 years ago
6b66db4
Get AMD GPU support working on Windows
Justine Tunney committed 2 years ago
1f1c53f
Introduce --gpu and --tinyblas flags
Justine Tunney committed 2 years ago
04d6e93
Introduce --nocompile flag
Justine Tunney committed 2 years ago
8762f13