Skip to content

Distribute and run LLMs with a single file.

Commits on main

Improve llamafile-convert command
Justine Tunney committed 2 years ago
703e03a
Add missing build rule
Justine Tunney committed 2 years ago
fb150ca
Release llamafile v0.6.2
Justine Tunney committed 2 years ago
d4c602d
Synchronize with llama.cpp 2024-01-27
Justine Tunney committed 2 years ago
dfd3335
Synchronize with llama.cpp 2024-01-26
Justine Tunney committed 2 years ago
c008e43
Make GPU auto configuration more resilient
Justine Tunney committed 2 years ago
e34b35c
Sanitize -ngl flag on Apple Metal
Justine Tunney committed 2 years ago
79b88f8
Release llamafile v0.6.1
Justine Tunney committed 2 years ago
389c389
Fix typo in OpenAI API
Justine Tunney committed 2 years ago
eb4989a
Change BM/BN/BK to template parameters (#203)
Gautham committed 2 years ago
4892494
Fix free() related crash in ggml-metal.m
Justine Tunney committed 2 years ago
9c85d9c
Clarify install/gpu docs/behavior per feedback
Justine Tunney committed 2 years ago
3e8aa78
Reduce server memory use on Windows
Justine Tunney committed 2 years ago
ed05ba9
Use hipcc on $PATH if it exists
Justine Tunney committed 2 years ago
67d97b5
Do better job reporting AMD hipBLAS errors
Justine Tunney committed 2 years ago
15e2339
Sync with llama.cpp upstream
Justine Tunney committed 2 years ago
133b05e
Update README.md -GPU windows (#186)
ThePersonOfFun committed 2 years ago
a193fd5
Mention FreeBSD ARM64 support in README.md
Justine Tunney committed 2 years ago
9216486
Don't crash when --image argument is invalid
Justine Tunney committed 2 years ago
c617679
Release llamafile v0.6
Justine Tunney committed 2 years ago
64d1e65
Add more content to manual
Justine Tunney committed 2 years ago
7ad00db
Upgrade to cosmocc 3.2.4
Justine Tunney committed 2 years ago
3384234
Show IP addresses when binding to 0.0.0.0
Justine Tunney committed 2 years ago
7a5ec37
Make browser tab launching more reliable
Justine Tunney committed 2 years ago
585c2d8
Enable setting thread affinity on NUMA systems
Justine Tunney committed 2 years ago
d39ec38
Support opening weights from llamafiles
Justine Tunney committed 2 years ago
bb136e1
Fix additional review issues with GPU config
Justine Tunney committed 2 years ago
5dff322
Fix indentation in log.c
Justine Tunney committed 2 years ago
3828eb8
Get AMD GPU support working on Linux
Justine Tunney committed 2 years ago
6559da6