Skip to content

LLM inference in C/C++

C++ ggml

Commits on master

sync : ggml
Georgi Gerganov committed 1 month ago
177cd8c
ggml : bump version to 0.25.1 (ggml/1637)
Georgi Gerganov committed 1 month ago
e4e2f62
dc9879c
4e416ee
ci : fix build-cmake runner target (#29299)
Sigbjørn Skjæret committed 1 month ago
26758d3
18f9f7b
model : support Gemma4 DSpark draft backbone (#29226)
Hrishith Thadicherla committed 1 month ago
633733d
ci : run python (jinja) test (#29302)
Sigbjørn Skjæret committed 1 month ago
86b2daa
make-release : update summary prompt
Georgi Gerganov committed 1 month ago
183d2a0
sync : ggml
Georgi Gerganov committed 1 month ago
45062d4
ggml : bump version to 0.25.0 (ggml/1635)
Georgi Gerganov committed 1 month ago
503549c
sycl : fix compile warnings
Georgi Gerganov committed 1 month ago
e97545d
vulkan: add IQ4_XS MMQ/MMV matmul kernels (#28415)
Piotr Wilkin (ilintar) committed 1 month ago
b1ff4ca
ggml-meta: resolve multi buffer views (#29266)
Ruben Ortlam committed 1 month ago
9425611
cuda: top-k MoE should always fire (#28432)
Aman Gupta committed 1 month ago
1a67982
sampler: reduce the size of the probe (#29285)
Max Krasnyansky committed 1 month ago
441df11
709fe75