Skip to content

LLM inference in C/C++

C++ ggml

Commits on master

llama : fix log message (#30452)
Georgi Gerganov committed 1 month ago
b476d9a
0a731cc
f851e24
bfe65e1
296538a
cuda : fix warnings from dead breaks (#30441)
Adrien Gallouët committed 1 month ago
882d671
cuda : warnings cleanup (#30420)
Adrien Gallouët committed 1 month ago
30f7df1
9d7d504
9880157
ggml-zdnn : introduce Q8_0 mat mul (#29836)
Aaron Teo committed 1 month ago
af50f2f
ci: fix OpenVINO download links (#30401)
Pratyush Kumar committed 1 month ago
a49f58d
model: fix vllm d3 multi seq case (#30408)
Xuan-Son Nguyen committed 1 month ago
cbe28bb
model: support vllm d3 models (#30383)
Xuan-Son Nguyen committed 1 month ago
efe3626
model: support vllm decision 2 model (#30378)
Xuan-Son Nguyen committed 1 month ago
097cf33
ccdbe29
metal : fix mul_mat_id with duplicate ids (#30373)
Georgi Gerganov committed 1 month ago
073b740
77757a3
ui: fix text attachment preview overflow (#29898)
shamnadxyz committed 1 month ago
2f160ba