Skip to content

LLM inference in C/C++

C++ ggml

Commits on master

vulkan: fix step operator for 0 input (#25036)
Ruben Ortlam committed 4 months ago
0b6529d
c299a92
ci : add windows-openvino to check-release (#25022)
Sigbjørn Skjæret committed 4 months ago
0275c0f
tests : fix test-chat-template --no-common option (#25075)
Sigbjørn Skjæret committed 4 months ago
83d385b
app : allow --version, --licenses & --help (#25054)
Adrien Gallouët committed 4 months ago
050ee92
3fc4e10
devops : add llama in all docker images (#25035)
Adrien Gallouët committed 4 months ago
5d8ccdf
arg: fix handling --spec-draft-hf and --hf-repo-v (#25043)
Xuan-Son Nguyen committed 4 months ago
024930c
sync : ggml
Georgi Gerganov committed 4 months ago
e7ea94a
ggml : bump version to 0.15.3 (ggml/1550)
Georgi Gerganov committed 4 months ago
96183e9
vulkan: opt mul_mat_vecq for mi50 (#22933)
nullname committed 4 months ago
487a6cc
c16c35b
server + ui: SSE Replay Buffer (#23226)
Pascal committed 4 months ago
1a87dcd
e7e3f35
mtmd: add more validations (#25013)
Xuan-Son Nguyen committed 4 months ago
b11f7c1
xcframework : disable mtmd video on i/tv/visionos (#25018)
Sigbjørn Skjæret committed 4 months ago
beac530
model : Add label for LFM2.5-230M (#25008)
Tarek Dakhran committed 4 months ago
9d5d882
CUDA: Various fixes to `cpy.cu` (#25000)
Oliver Simons committed 4 months ago
1ec44d1
misc: fix labeler (#25012)
Xuan-Son Nguyen committed 4 months ago
c7cddef
server: use status code 403 for disabled features (#24970)
Xuan-Son Nguyen committed 4 months ago
e9d1b76
misc: update lables (#24920)
Xuan-Son Nguyen committed 4 months ago
099bf06
common: refactor model handling (#24980)
Xuan-Son Nguyen committed 4 months ago
60bc886