Skip to content
Arm
Git
Search or jump to…
Ctrl K
Categories
Theme: System
Sign in
Get started
armgit
/
llamafile
Public
Imported from GitHub
Fork
0
Watch
0
Star
0
Distribute and run LLMs with a single file.
C++
cross-platform
gguf
llama-cpp
local-ai
local-inference
local-llm
open-source-ai
single-file-executable
speech-to-text
Code
Commits
Issues
Pull requests
Wiki
Builds
Discussions
Projects
Insights
Search
main
19 branches · 44 tags
Go to file
t
Code
Commits on
main
Fix POSIX undefined cancelation behavior
Justine Tunney committed 2 years ago
8604e9a
Copy SHA
Add barebones /completion endpoint to new server
Justine Tunney committed 2 years ago
fb3421c
Copy SHA
Update Discord invite link
Stephen Hood committed 2 years ago
814780a
Copy SHA
Make GGML asynchronously cancelable
Justine Tunney committed 2 years ago
b3930aa
Copy SHA
Add support for JSON parameters to new server
Justine Tunney committed 2 years ago
d7c8e33
Copy SHA
Revert "Disable warmup"
Justine Tunney committed 2 years ago
1601118
Copy SHA
Disable warmup
Justine Tunney committed 2 years ago
21a30be
Copy SHA
Release llamafile v0.8.9
Justine Tunney committed 2 years ago
cd84736
Copy SHA
Make gemma2-27b-it the same as aistudio.google.com
Justine Tunney committed 2 years ago
af22695
Copy SHA
Add sliding window mask for Gemma2
Xuan Son Nguyen committed 2 years ago
41678c8
Copy SHA
Reclaim llama_decode() memory on cancelation
Justine Tunney committed 2 years ago
0d62d05
Copy SHA
Remove ggml_context cache
Justine Tunney committed 2 years ago
617d841
Copy SHA
Upgrade to Cosmopolitan v3.5.4
Justine Tunney committed 2 years ago
3af1ac0
Copy SHA
Add soft-capping to Gemma2
Andrei committed 2 years ago
140eed5
Copy SHA
Use float to string conversion
Justine Tunney committed 2 years ago
263d39b
Copy SHA
Upgrade to Cosmopolitan v3.5.3
Justine Tunney committed 2 years ago
3fc00b1
Copy SHA
Create /embedding endpoint in new server
Justine Tunney committed 2 years ago
1346ef4
Copy SHA
Refactor new server and get leak checker working
Justine Tunney committed 2 years ago
46dda4f
Copy SHA
Prevent vector overflow in llama.cpp
Justine Tunney committed 2 years ago
cd73243
Copy SHA
Release llamafile v0.8.8
Justine Tunney committed 2 years ago
571b4e5
Copy SHA
Support flash attention in --server mode
Justine Tunney committed 2 years ago
4aea606
Copy SHA
Add Google Gemma v2 support
Justine Tunney committed 2 years ago
7692b85
Copy SHA
Introduce --special flag
Justine Tunney committed 2 years ago
72fb8ca
Copy SHA
Don't flush bf16 subnormals to zero
Justine Tunney committed 2 years ago
7fd9101
Copy SHA
Release llamafile v0.8.7
Justine Tunney committed 2 years ago
b2f587c
Copy SHA
Cut flash attention from CUDA again
Justine Tunney committed 2 years ago
4d1fde0
Copy SHA
Fix server crash due to /dev/urandom
Justine Tunney committed 2 years ago
629e208
Copy SHA
Upgrade to Cosmopolitan v3.5.1
Justine Tunney committed 2 years ago
0c0e72a
Copy SHA
Pacify --temp flag when running in server mode
Justine Tunney committed 2 years ago
6d3590c
Copy SHA
Always use tinyBLAS with AMD GPUs on Windows
Justine Tunney committed 2 years ago
60404a8
Copy SHA
Newer
Older