LLM inference in C/C++
C++ ggml
Commits on master
vulkan : check for null vkEnumerateInstanceVersion (#29872)
58cb913 Ian McKellar committed 1 month ago
models : consolidate nextn row cropping into shared helpers (#30017)
f0c41e0 Georgi Gerganov committed 1 month ago
scripts : limit apiabi checks to libllama and libmtmd (#30038)
d7a695e Daniel Bevenius committed 1 month ago
convert : add text_config as fallback [transformers 5.18] (#30040)
6c73b3e Kartik Gulia committed 1 month ago
llama : re-reserve the sched when the nextn extraction flags change (#30020)
1a3011c Piotr Wilkin (ilintar) committed 1 month ago
ggml: refactor selective expert copying to user code (#29943)
6753a03 Aman Gupta committed 1 month ago
test-llama-archs : initialize backends before generating models (#30034)
cbb7d52 Ihar Hrachyshka committed 1 month ago
vendor : update LibreSSL to 4.3.3 [no ci] (#30019)
63bef27 Alessandro de Oliveira Faria (A.K.A.CABELO) committed 1 month ago
ggml-openvino: fix CI tests; fix GPU regressions. (#30037)
b9a5a00 Ravi Panchumarthy committed 1 month ago
llama: fix k-pool scatter data race on shared sequences (#29994)
43fe9c6 Pascal committed 1 month ago
ci : skip container re-tagging when Require Docker is disabled (#30008)
c250304 Georgi Gerganov committed 1 month ago
hexagon: matmul and flash-atten scalability updates (#29974)
8345f33 Max Krasnyansky committed 1 month ago
common, server : report model input/output modalities in GET /models (#29987)
4d60b4d Adrien Gallouët committed 1 month ago
vulkan: fix Flash Attention shmem write out of bounds (#29988)
6c59c40 Ruben Ortlam committed 1 month ago
ci : add "Require Docker" flag to make-release workflow (#29989)
994e8f2 Georgi Gerganov committed 1 month ago
webui: Use toLocaleString() format consistently across chat message statistics (#27990)
9d853bb Giovanni Rivera committed 1 month ago
ci : disable failing test on virtual Metal device (#29993)
8f9ae20 Georgi Gerganov committed 1 month ago
CUDA: Optimize accumulation in mmq for NVFP4 type (#29857)
8b2fbaf Konrad Moren committed 1 month ago