Skip to content

LLM inference in C/C++

C++ ggml

Commits on master

opencl: fix local size for norm (#27339)
lhez committed 3 months ago
6b4fa88
ui: Stores split refactor (#27240)
Aleksander Grygier committed 3 months ago
521a64c
mtmd: add --mmproj-device argument (#23255)
John-Henry Lim committed 3 months ago
681c29d
model : support DSpark for LFM2 models (#27383)
Tarek Dakhran committed 3 months ago
07822bd
metal : dequant kv cache only for large batches (#27438)
Georgi Gerganov committed 3 months ago
63b64a5
9855ad6
server : fix --docker-repo being treated as router mode (#27416)
Aritro Bandyopadhyay committed 3 months ago
8a832e4
Revert "tensor-split meta backend fixes (#26502)" (#27433)
Georgi Gerganov committed 3 months ago
f20395d
8497981
d9b6be0
929d47a
spec : avoid binding reference to null pointer (#27404)
Georgi Gerganov committed 3 months ago
f466cfa
vulkan : add source groups for shaders (#26666)
Markus Tavenrath committed 3 months ago
2cfdb5f
9ee9fc0
tensor-split meta backend fixes (#26502)
Max Krasnyansky committed 3 months ago
d59d455
vulkan : dequant q8_0 KV once in coopmat1 (#25494)
Nathanw1014 committed 3 months ago
dc72703