Skip to content

LLM inference in C/C++

C++ ggml

Commits on master

hexagon: add support for GEGLU_QUICK (#29114)
Aparna M P committed 2 months ago
851cb34
hexagon: enable support for TOP_K op (#29113)
Aparna M P committed 2 months ago
7d4b92b
server : improve startup log messages (#29125)
Georgi Gerganov committed 2 months ago
1af554f
eb1e1f4
metal : add MoE and SSM_CONV fusion optimizations (#28948)
Georgi Gerganov committed 2 months ago
5b59b83
metal : fix FA support checks (#29122)
Georgi Gerganov committed 2 months ago
60b06ab
test-llama-archs : generate dummy test vocab (#29084)
Georgi Gerganov committed 2 months ago
efa28e9
metal : support qwen4exp hc ops (#29000)
Georgi Gerganov committed 2 months ago
59fc5a1
b23701f
hexagon: add ROLL op support (#29105)
Todor Boinovski committed 2 months ago
2b18470
hexagon: im2col update (#29103)
Todor Boinovski committed 2 months ago
50631b3
ggml-cpu: add F16 input to the FWHT (#27779)
bri-prism committed 2 months ago
4fea119
5b335f4
ci: change ubuntu-latest to ubuntu-24.04 (#29079)
Aaron Teo committed 2 months ago
d663dd3
ggml-webgpu: fix supports_op condition for GET_ROWS (#28978)
Masashi Yoshimura committed 2 months ago
44be98f
vulkan: add IQ3_S MMQ matmul kernels (#28822)
Daniel Varga committed 2 months ago
bbd488c
vocab : add ufakzeka pre-tokenizer (#29033)
Sait Furkan Teke committed 2 months ago
dc85f89
8ed1a55
ci : disable GHA cache for copilot (#29068)
Sigbjørn Skjæret committed 2 months ago
f03cf3e
ci : bump android-actions/setup-android to 4.0.4 (#29065)
Sigbjørn Skjæret committed 2 months ago
bdcbaaf
ci : add missing evict-old-files (#29041)
Sigbjørn Skjæret committed 2 months ago
972d231
rpc : skip ACCEL devices (#29020)
Pedro Cuenca committed 2 months ago
c77ae69
b49650a