LLM inference in C/C++
C++ ggml
Commits on master
openvino : Update OpenVINO to 2026.4;fix clangd,MSVC warnings; (#29009)
ebbb185 Ravi Panchumarthy committed 2 months ago
ui: fix removed reasoning menu in single model mode on desktop (#27985)
4ff829e Benjamin Babik committed 2 months ago
vulkan: split buffers and debug code into separate files, add shared headers (#28732)
f172be7 Ruben Ortlam committed 2 months ago
ci : add API/ABI check to make-release workflow [no ci] (#28947)
87f9c82 Daniel Bevenius committed 2 months ago
chat : add message delimiters to the DeepSeek V3.2/V4 parser (#29008)
7f6f0c2 midagedev committed 2 months ago
gguf : align the data section relative to the GGUF start, not the file (#28993)
81aeaeb Yuri Khrustalev committed 2 months ago
sycl : fix the B70 mem allocate error when >19.3GB (#28953)
c9a5eee Neo Zhang committed 2 months ago
vulkan: skip unneeded MoE work in mul_mm coopmat1 path (#25483)
7490357 Jiang, Fish committed 2 months ago
sycl: ssm_conv: fuse the SiLU epilogue into the ssm_conv kernel (#28929)
817e5f8 Titaniumtown committed 2 months ago
docs: remove JG as CODEOWNER for test-llama-archs (#29003)
79bfc1d Johannes Gäßler committed 2 months ago
vulkan: fix buffer_reference alignment in im2col shaders (#28996)
05f2dcf Abir Deol committed 2 months ago
[SYCL] Fix function signature for `ggml_backend_sycl_split_buffer_type` (#28981)
aa39d7a Michael Taylor committed 2 months ago
vulkan: work around NV bug with argsort_large.comp (#28975)
4bc272f Jeff Bolz committed 2 months ago
TP: fix split state and granularity for fused QKV gemma4, qwen35 (#28965)
fb27a52 David Friehs committed 2 months ago
hexagon: accept the zeroed rope probe in supports_op (#28995)
82324fc Marco Colombo committed 2 months ago
models : allow Nemotron-H models to only define layer_norm_epsilon (#28989)
7ceed87 Kartik Gulia committed 2 months ago
model : add support for HrmTextForCausalLM (DFM Mimir 1B) (#27625)
7d6f5d0 George committed 2 months ago
spacemit : fix wrong transpose function for int16 data (#25161)
f266648 I3eg1nner committed 2 months ago
rpc : invalidate cached compute graph when a referenced buffer is freed (#24292)
6019933 y198 committed 2 months ago
Change max context length for auto-fitting with unified KV (#28849)
b04d4e5 Gaurav Garg committed 2 months ago
HIP: broaden MoE ncols_opt tile heuristic on RDNA3.5 architecture (#28935)
fccf716 WenqiangJia2026 committed 2 months ago
chat : force `\n</think>` on reasoning budget end for qwen3-coder (#28869)
0bec16e Aldehir Rojas committed 2 months ago