Skip to content

LLM inference in C/C++

C++ ggml

Commits on master

14a9d09
e2d2c0d
mtmd: propagate video ID to bitmap (#28601)
Xuan-Son Nguyen committed 2 months ago
6de9cdb
vulkan: add dedicated iq4_xs mat-vec shader (#28426)
WakeUpMorty committed 2 months ago
df750f7
tests : use less threads for data initialization (#28325)
Georgi Gerganov committed 2 months ago
30b6a75
Add IQ type handling for MoE (#28476)
cwriter committed 2 months ago
304665f
f3f1a8f
ggml : fix msvc+clang ggml_vld1q_u32 (#28284)
Sarah Wu committed 2 months ago
9113cc1
88ada91
ci : disable npm gha cache (#28600)
Sigbjørn Skjæret committed 2 months ago
03fa73c
1744c6b
llama : add missing headers (#28566)
Pepper Gray committed 2 months ago
ca86fb2
64e9bce
chat : split specialized parsers into common/parsers (#27764)
Piotr Wilkin (ilintar) committed 2 months ago
895c045
ggml : update ggml_prec specification (#26675)
Georgi Gerganov committed 2 months ago
5a6caa0
9dcf84e
hexagon: add RELU and LEAKY_RELU ops (#28585)
Todor Boinovski committed 2 months ago
050dde5
ci : bump ty to 0.0.78 (#28548)
Sigbjørn Skjæret committed 2 months ago
67672dc
f114f91
nix : update deprecated expressions (#28145)
Zhaolun Yin committed 2 months ago
ccc3646
c0b1871
160bd03