Skip to content

LLM inference in C/C++

C++ ggml

Commits on master

ggml : optimize AMX (#24806)
Adrien Gallouët committed 5 months ago
37a77fb
convert : more consistent handling of rope_parameters (#24833)
Sigbjørn Skjæret committed 5 months ago
f4043fe
ggml-webgpu: add adapter toggles for F16 on Vulkan + NVIDIA
Masashi Yoshimura committed 5 months ago
f449e05
server: refactor child --> router communication (#24821)
Xuan-Son Nguyen committed 5 months ago
2b686a9
server : optimize get_token_probabilities (#24796)
Adrien Gallouët committed 5 months ago
4b48a53
mtmd, arg: fix utf8 handling on windows (#24779)
Xuan-Son Nguyen committed 5 months ago
e475fa2
175147e
arg: Add comment line support to --api-key-file (#23168)
Mikolaj Kucharski committed 5 months ago
fabde3b
vendor : update cpp-httplib to 0.48.0 (#24787)
Alessandro de Oliveira Faria (A.K.A.CABELO) committed 5 months ago
0d2d9cc
docker : build the UI (#24794)
Aldehir Rojas committed 5 months ago
38724ab
mtmd: several bug fixes (#24784)
Xuan-Son Nguyen committed 5 months ago
e2e7a9b
spec: support eagle3 for qwen3.5 & 3.6 (#24593)
Ruixiang Wang committed 5 months ago
b14e3fb
159d093
sync : ggml
Georgi Gerganov committed 5 months ago
5fd2dc2
ggml : bump version to 0.15.2 (ggml/1548)
Georgi Gerganov committed 5 months ago
1868af1
pi : remove docs from system prompt (#24791)
Georgi Gerganov committed 5 months ago
5bd21b8
80452d6
8141e73
mtmd: add batching support for internvl (#24775)
Xuan-Son Nguyen committed 5 months ago
db52540
Ggml/cuda col2im 1d (#24417)
Pascal committed 5 months ago
3a3edc9
mtmd: add batching for mtmd-cli, add video tests (#24778)
Xuan-Son Nguyen committed 5 months ago
a6b3260
32eddaf
fe7c8b2
server: add "schema" and validation (#24150)
Xuan-Son Nguyen committed 5 months ago
e1efd09
0802307