Distribute and run LLMs with a single file.
C++ cross-platformggufllama-cpplocal-ailocal-inferencelocal-llmopen-source-aisingle-file-executablespeech-to-text
Commits on main
feat(help): list all accepted llama.cpp options in --help (#1003)
84e3e1a Richard Tweed committed 4 months ago
Add HTTPS support via cpp-httplib's mbedtls backend (#1011)
a03a7c8 Davide Eynard committed 4 months ago
transcribefile: Metal GPU support via llamafile's runtime loader (#1010)
18aee94 Davide Eynard committed 4 months ago
transcribefile: CPU build of transcribe.cpp + sync to df1a4ad (#1007)
1281813 Davide Eynard committed 4 months ago
vulkan: clearer message when --gpu vulkan is explicitly unavailable (#1006)
9ff770c Davide Eynard committed 4 months ago
CPU / GPU fixes + harness for upstream ggml's test-backend-ops (#1004)
92174c7 Davide Eynard committed 4 months ago
chore: upgrade and digest pin all action digests (#1002)
3917d47 Richard Tweed committed 4 months ago
skill: guardrail llama.cpp update workflow with patch commands (#998)
c6d052c Davide Eynard committed 4 months ago
docs(support): add GPU backend status table and acceleration verification (#997)
6e7e103 Tai An committed 5 months ago
Probe GPU device count out-of-process on Windows (#988 follow-up) (#994)
b1b7814 Davide Eynard committed 5 months ago
Fix uncaught SIGSEGV when GPU init fails, restore CPU fallback (#988) (#989)
6e28ad2 Davide Eynard committed 5 months ago
Update llama.cpp submodule to dbe9c0c (+ embed real web UI) (#983)
7bb2d88 Davide Eynard committed 5 months ago
common.cpp: detect physical cores at runtime under cosmocc (fix #976) (#977)
b2d21fd Davide Eynard committed 5 months ago
CPU flash-attention fixes for #975 (workaround + AVX-512 helpers + simd_gemm) (#978)
4905d74 Davide Eynard committed 5 months ago
ggml-cpu: re-hook llamafile MoE matmul on x86 (partial fix for #973) (#974)
42a4006 Davide Eynard committed 6 months ago
docs: rename example_llamfiles to pre-built-llamafiles for better seo (#972)
cfa8120 angpt committed 6 months ago
Added executable dir to list of dylib valid paths (#959)
edb2fd0 Davide Eynard committed 6 months ago