Skip to content

Distribute and run LLMs with a single file.

Commits on main

Check in some experimental whisper programs
Justine Tunney committed 2 years ago
70e3dcd
Refactor cpu_get_num_math() with cores.h header
Justine Tunney committed 2 years ago
484a1b2
Upgrade to Cosmopolitan v3.9.1
Justine Tunney committed 2 years ago
ce85577
Improve the pool
Justine Tunney committed 2 years ago
66a84d8
Upgrade to Cosmopolitan v3.8.0
Justine Tunney committed 2 years ago
ea39f26
Speed up KV in llamafile-bench
Justine Tunney committed 2 years ago
c7c4d65
Ignore --repeat-penalty in server
Justine Tunney committed 2 years ago
d2be732
Fix build
Justine Tunney committed 2 years ago
8685f67
Make replace_all() have linear complexity
Justine Tunney committed 2 years ago
2c940da
Use bf16 kv cache when it's faster
Justine Tunney committed 2 years ago
fa4c4e7
Quantize TriLM models using Q2_K_S (#552)
Kawrakow committed 2 years ago
98eff09
Always favor fp16 arithmetic in tinyBLAS
Justine Tunney committed 2 years ago
c44664b
Update markdown documentation on audio conversion
Justine Tunney committed 2 years ago
6287b60
Improve whisperfile flag handling slightly
Justine Tunney committed 2 years ago
8a5a724
Convert audio files (mp3/flac/ogg) to 16khz wav
Justine Tunney committed 2 years ago
dc99002
Vendor miniaudio v0.11.21
Justine Tunney committed 2 years ago
2043660
Vendor stb_vorbis v1.22
Justine Tunney committed 2 years ago
34c1514
Fix bug in whisperfile man page.
Justine Tunney committed 2 years ago
dab2317
Mention --no-prints in whisperfile man page
Justine Tunney committed 2 years ago
c8b483f
Release llamafile v0.8.13
Justine Tunney committed 2 years ago
b17ccd1
Add OpenAI /v1/embeddings to new llamafiler server
Justine Tunney committed 2 years ago
be94c1f
Schlep in Chromium Zlib
Justine Tunney committed 2 years ago
2232b0e
Disable GGML_CUDA_FORCE_MMQ
Justine Tunney committed 2 years ago
698de91
Fix undefined behavior in llava clip
Justine Tunney committed 2 years ago
65745b0
Write a lot of documentation and man pages
Justine Tunney committed 2 years ago
202e554
Use colorblind friendly TTY colors in whisperfile
Justine Tunney committed 2 years ago
7450034
Implement the real trick to GeLU with proof
Justine Tunney committed 2 years ago
b5748f3
Sync more sources and fix regressions
Justine Tunney committed 2 years ago
b1c1703
Sync with upstream projects
Justine Tunney committed 2 years ago
1ca6e42
Bring new server up to 2421 embedding/sec
Justine Tunney committed 2 years ago
070aa13