Skip to content

LLM inference in C/C++

C++ ggml

Commits on master

2083217
server: (router) rework -hf preset repo (#24739)
Xuan-Son Nguyen committed 5 months ago
552258c
24bba7b
9724f66
dd69db2
ci : fix check-release message parsing (#24751)
Sigbjørn Skjæret committed 5 months ago
32e806b
ui: Update code formatting command in pre-commit hook (#24685)
Aleksander Grygier committed 5 months ago
0b73fc7
ci : fix Windows x64 (OpenVINO) release link (#24731)
Ravi Panchumarthy committed 5 months ago
4a79037
metal : check for BF16 support in concat kernel (#24747)
Georgi Gerganov committed 5 months ago
cae0a3b
mtmd: llava_uhd should no longer use batch dim (#24732)
Xuan-Son Nguyen committed 5 months ago
f3e1828
metal : implement rope_back operator (#24725)
Georgi Gerganov committed 5 months ago
0843245
8d2e580
server: (router) add model management API (#23976)
Xuan-Son Nguyen committed 5 months ago
4b4d13a
1a2dea2
[SYCL] add dev2dev memcpy by SYCL API (#24476)
Neo Zhang committed 5 months ago
74a80dd
[SYCL] Add conv_3d (#24691)
Neo Zhang committed 5 months ago
d1759e4
webui: export conversations as jsonl (#24688)
Julien Chaumond committed 5 months ago
8086439
ci: fix vulkan docker images (#24595)
kononnable committed 5 months ago
d5376cf