LLM inference in C/C++
C++ ggml
Commits on master
ui: degrade the working directory picker when file search is off (#26811)
74ce157 Pascal committed 3 months ago
ggml-cpu : fix missing Q5_0 dispatch in SpaceMiT backend (#26792)
0865990 Hao-Chen2337 committed 3 months ago
server: report the isolate working directory from get_info (#26773)
7ba604f Pascal committed 3 months ago
CUDA: fuse rms_norm + mul + rope (+ view + set_rows) (#26767)
687e778 Rafail Giavrimis committed 3 months ago
server, ui: only offer a working directory when a tool reads it (#26762)
18f7ad7 Pascal committed 3 months ago
server: add initial tool isolation support (via docker) (#26507)
dd2c7c4 Xuan-Son Nguyen committed 3 months ago
CUDA: fix thread/block count in quantized cpy kernel launches (#26731)
69bf643 Rafail Giavrimis committed 3 months ago
tts: account for the vocoder pass in the timings line (#26733)
3653e6d Pascal committed 3 months ago
metal : fix NORM/RMS_NORM for row lengths that leave a partial simdgroup (#26708)
a194a75 robertomeroni committed 3 months ago
mtmd: fix longest_edge ignoring min/max pixels (#26638)
4cb22cd Xuan-Son Nguyen committed 3 months ago
server : clarify comment in eval_llama_cmpl_schema [no ci] [no release] (#26720)
9ba73fd Daniel Bevenius committed 3 months ago
webui: load the model selected via ?model= when ?load=true (#26707)
f4f7758 Emanuil Rusev committed 3 months ago
ui: set npm `min-release-age` to protect against supply-chain attacks (#26711)
34e9ee5 Niklas Wenzel committed 3 months ago
mtmd: stop feeding the text stream again during Qwen3-TTS generation (#26706)
217df17 Pascal committed 3 months ago
ggml : add aarch64 HWCAP fallbacks and fix fp16 variant detection (#25554)
cb26014 Kilian Hu committed 3 months ago
Mitigate crashing issue on Windows MSYS2 UCRT64 environment (GCC 16.1.0) (#26555)
42e9881 Masato Nakasaka committed 3 months ago