Skip to content

LLM inference in C/C++

C++ ggml

Commits on master

vendor : update cpp-httplib to 0.61.0 (#30494)
Adrien Gallouët committed 1 month ago
3eb1013
ggml : improve RPC tensor transfer logs (#30481)
Georgi Gerganov committed 1 month ago
af0579c
jinja : write floats in tojson as Python does (#30362)
Yuri Khrustalev committed 1 month ago
77390ba
4dd6dd4
vulkan: fix compile error (#30495)
Ruben Ortlam committed 1 month ago
1431019
vulkan: support mulmat bf16 activations (#29069)
Ruben Ortlam committed 1 month ago
7ec420b
convert : export YaRN truncation config (#30288)
Takamichi Ohara committed 1 month ago
eca5458
fcac190
04f7226
chat: replace output string with parts (#30389)
Xuan-Son Nguyen committed 1 month ago
ff026f8
1b70350
docs : update zDNN supported ops (#30472)
Aaron Teo committed 1 month ago
d71e324
45451c3
ecdd29e
ec0bfac
b9f3599
f441d2d