Skip to content

LLM inference in C/C++

C++ ggml

Commits on master

sycl: Add optional USM system allocations (#22526)
Francois Dugast committed 5 months ago
9b260fc
vendor : update BoringSSL to 0.20260616.0 (#24693)
Alessandro de Oliveira Faria (A.K.A.CABELO) committed 5 months ago
74ade52
02810c7
spec: add backend sampling support for eagle3 (#24655)
Ruixiang Wang committed 5 months ago
a182490
d5fb104
bench : add --offline (#24511)
Adrien Gallouët committed 5 months ago
e3a74b2
sycl : Make GGML_SYCL_F16=ON the default (#23996)
Todd Malsbary committed 5 months ago
4196b47
vulkan: add col2im_1d op (#24425)
Pascal committed 5 months ago
ad39cca
7dad2f1
mtmd: fix miscounting n_tokens (#24656)
Xuan-Son Nguyen committed 5 months ago
e36a602
chat: include full unparsed prompt in debug (#24650)
Piotr Wilkin (ilintar) committed 5 months ago
38d5463
a1eb756
581e8ec
mtmd : add post-decode callback (#24645)
Georgi Gerganov committed 5 months ago
e3cab40
vulkan: support more CONCAT types (#24579)
Jeff Bolz committed 5 months ago
9dbc662
wasm : fix fallback symbol collision (#24639)
Andrei committed 5 months ago
6eab471
e3bb1ad
sycl: fix soft_max_f32 max reduction (#24451)
someoneinjd committed 5 months ago
d8a3f52
c035ff4