Distribute and run LLMs with a single file.
C++ cross-platformggufllama-cpplocal-ailocal-inferencelocal-llmopen-source-aisingle-file-executablespeech-to-text
Commits on main
server: accept Unix socket paths shorter than 14 bytes (#1073)
6bfbec3 Pablo De Chiaro Rosa committed 15 days ago
fix(server): bind the listening socket before the sandbox (#1072)
aec705e Pablo De Chiaro Rosa committed 16 days ago
server: fix built-in shell tools on Windows (#1066) (#1069)
fc73281 Manu Nicholas Jacob committed 16 days ago
docs(support): update GPU notes for the 0.10 libraries (#1071)
9b7e5f5 Pablo De Chiaro Rosa committed 16 days ago
feat(chat): unify /stats across both chat backends (#1076)
879941f Davide Eynard committed 16 days ago
Updated vulkan.sh/.bat to check and use recent toolchain
017cdeb Davide Eynard committed 2 months ago
fix(ggml): use `ggml_time_init()` in `ggml_time_ms` and `ggml_time_us` so that `timer_freq` is initialised (#1054)
0c59e52 Davide Eynard committed 2 months ago
Updated ggml build scripts with -DGGML_CUDA_USE_GRAPHS / -DGGML_HIP_GRAPHS=1 (#1051)
42ff11b Davide Eynard committed 2 months ago
fix(build): compile the ggml objects with -DNDEBUG (#1050)
6719ace Davide Eynard committed 2 months ago
fix(build): add missing link recipes for llama.cpp tools (#1034)
c73be59 Dex Hunter committed 2 months ago
fix(zip): guard extra-field header read before bounds are known 🛡️ (#1044)
5ac1c4d Jeremy Schoemaker committed 2 months ago
llamafile_open_zip: validate the zip entry window against the actual file size (#1039)
37c1716 m00dy committed 2 months ago
docs(support): document the Vulkan GPU backend (#1029) (#1033)
486e6c5 Tai An committed 3 months ago
build(install): install transcribefile so it ships as a release artifact (#1035) (#1036)
52b7727 Tai An committed 3 months ago
docs(quickstart): clarify llamafile vs llamafile-thin and other release binaries (#1022) (#1023)
cbe844c Tai An committed 3 months ago
Temp fix to fetch-ui-assets (increase #elements in pagination)
1ef985e Davide Eynard committed 4 months ago