Skip to content

LLM inference in C/C++

C++ ggml

Commits on master

metal : add top-k radix implementation (#28073)
Georgi Gerganov committed 2 months ago
2a74817
2d8d612
ROCm: add radix TOP_K for long rows (#27466)
Jaden_Mach committed 2 months ago
f8dbcd6
metal : add fa-vec tunings for M1 (#28078)
Niklas Wenzel committed 2 months ago
5d4a3be
a32af33
ci : add check for unzip (#28082)
Sigbjørn Skjæret committed 2 months ago
580e88d
hexagon: fix CPY fence bug (#28033)
Shenghan Yang committed 2 months ago
9723942
6d1479c
ggml: add SWIGLU_CLAMP (#27930)
Aman Gupta committed 2 months ago
0190529
llama: improve TENSOR_READ_LAZY handling (#27837)
Xuan-Son Nguyen committed 2 months ago
2578138
hip: tune rdna 3 mmq config (#26284)
itterative committed 2 months ago
0b5be7e
e422148
742347b
metal: add fa-vec tunings for M3 Ultra (#27999)
Nils Gladitz committed 2 months ago
093adb2
metal : Add fa-vec tuning for M3 Pro (#27963)
Daya Adianto committed 2 months ago
b8b743c