Skip to content

LLM inference in C/C++

C++ ggml

Commits on master

sycl: guard DMMV reads at row tails (#29338)
Frosty40 committed 1 month ago
f9a95ae
a05e58c
hexagon: optimize q2_k bpw and activation (#30035)
Jhen-Jie Hong committed 1 month ago
e937b17
hexagon: add IM2COL_3D (#30305)
kurquhar committed 1 month ago
b13a93a
model : support for Prism Bonsai 2 27B (#29600)
bri-prism committed 1 month ago
a9d27ac
server: add component tests (#30312)
Xuan-Son Nguyen committed 1 month ago
62a6f74
model : support MiniCPM-V 4.7 (#29416)
tc-mb committed 1 month ago
69f201a
aa94f20
spec: properly handle mtmd input for mtp (#30257)
Xuan-Son Nguyen committed 1 month ago
781dbc5
mtmd: add build_inp_attn_mask (#30259)
Xuan-Son Nguyen committed 1 month ago
0fd868c
1623d8c
2bbca8f
404f557
ggml: fix s390x all cpu build (#30140)
Aaron Teo committed 1 month ago
b797c82
10a60cf
graph : reorder get_rows for embeddings (#30160)
Georgi Gerganov committed 1 month ago
8e2d31e
ui: Models Manager Follow-up Improvements (#30228)
Aleksander Grygier committed 1 month ago
baef3ed