LLM inference in C/C++
C++ ggml
Commits on master
binaries : Improve rpc-server and export-graph-ops names. (#25045)
c299a92 Christian Kastner committed 4 months ago
tests : fix test-chat-template --no-common option (#25075)
83d385b Sigbjørn Skjæret committed 4 months ago
sched : reintroduce less synchronizations during split compute (#20793)
3fc4e10 Andreas Kieslinger committed 4 months ago
arg: fix handling --spec-draft-hf and --hf-repo-v (#25043)
024930c Xuan-Son Nguyen committed 4 months ago
openvino: Update to OV 2026.2.1, self-contained release packages, operator improvements (#24974)
5397c36 Ravi Panchumarthy committed 4 months ago
vulkan: add INTEL_XE1 arch enum and enable coopmat1 on Intel Xe-LPG Plus (#24404)
5a6a0dd Jiang, Fish committed 4 months ago
ui: fix accessibility for hover-gated interactive elements assisted by claude(in debugging and tests) (#24727)
ded1561 Sanjay Ahari committed 4 months ago
vulkan: Workaround compiler bug in conv2d coopmat2 path (#24924)
9df0680 Jeff Bolz committed 4 months ago
CUDA: add cublasSgemmBatched mapping for HIP/MUSA vendor headers (#25033)
2f18fe1 leonardHONG committed 4 months ago
ggml-cpu: fix SVE leftover path in ggml_vec_dot_f32 (#24699)
c16c35b Tarek Dakhran committed 4 months ago
CUDA: batch out_prod broadcast (dps2>1) path with cublasSgemmBatched (#24426)
f818065 leonardHONG committed 4 months ago
mamba2: remove hardcoded 2x expansion factor and invalid d_inner % d_state check (#23082)
960d628 Arsen Arutunan committed 4 months ago
opencl: flush profiling batch at shutdown for incomplete batches (#25016)
5c7c22c shaofeiqi committed 4 months ago
xcframework : disable mtmd video on i/tv/visionos (#25018)
beac530 Sigbjørn Skjæret committed 4 months ago
server: use status code 403 for disabled features (#24970)
e9d1b76 Xuan-Son Nguyen committed 4 months ago