LLM inference in C/C++
C++ ggml
Commits on master
server : return HTTP 400 on invalid grammar (#24144) (#24154)
1078621 Anuj Attri committed 5 months ago
server: fix router args not being forwarded to child instances (#24760)
968c438 Xuan-Son Nguyen committed 5 months ago
mtmd: refactor preprocessor, add mtmd_image_preproc_out (#24736)
24bba7b Xuan-Son Nguyen committed 5 months ago
app : enable self-update only when built with llama-install.sh (#24754)
6ec59dd Adrien Gallouët committed 5 months ago
[SYCL] support OPs: conv_2d, conv_2d_dw, conv2d_transpose (#24600)
6f1034b Neo Zhang committed 5 months ago
ui: Update code formatting command in pre-commit hook (#24685)
0b73fc7 Aleksander Grygier committed 5 months ago
ci : fix Windows x64 (OpenVINO) release link (#24731)
4a79037 Ravi Panchumarthy committed 5 months ago
metal : check for BF16 support in concat kernel (#24747)
cae0a3b Georgi Gerganov committed 5 months ago
mtmd: llava_uhd should no longer use batch dim (#24732)
f3e1828 Xuan-Son Nguyen committed 5 months ago
ggml-cpu: Conditionally enable power11 backend based on compiler support (#24687)
2e88c49 shalinib-ibm committed 5 months ago
metal : add f16 and bf16 support for concat operator (#24724)
8d2e580 Georgi Gerganov committed 5 months ago
llama : skip main_gpu validation when no devices are available (#23405)
b4024af Dev-iL committed 5 months ago
spec: fix segfault error on long prompts for eagle3 (#24707)
1a2dea2 Ruixiang Wang committed 5 months ago
vulkan: record actual memory properties during buffer creation (#24326)
558e221 Winston Ma committed 5 months ago
Revert "cuda: reset cuda context after reading memory size (#23935)" (#24715)
ea21e03 Ruben Ortlam committed 5 months ago
UI : fix SSE transport detection and routing through CORS proxy. Assi… (#24500)
bae36ef Harapan Rachman committed 5 months ago
common: update logging to enforce max_capacity and optimize queue resizing (#24490)
cda6385 Max Krasnyansky committed 5 months ago
openvino: OV 2026.2, context-shift, Q5_1 support, gemma4 dense/embedding, and -fa off (#24503)
890f1a2 Zijun Yu committed 5 months ago