Skip to content

LLM inference in C/C++

C++ ggml

Commits on master

dac3087
vendor : update cpp-httplib to 0.60.1 (#30134)
Adrien Gallouët committed 1 month ago
03aa006
sycl: FWHT optimizations (#29605)
bri-prism committed 1 month ago
46baf1f
sycl: add grouped MoE XMX GEMM (#29245)
cwriter committed 1 month ago
847f447
convert : support Qwen3.5 embedding models (#27920)
Sam Malayek committed 1 month ago
75118a3
hexagon: enable alloc_buffer_n (#30126)
Max Krasnyansky committed 1 month ago
9c2e0e4
hexagon: Q6_K weight dequant speedup (#30121)
kurquhar committed 1 month ago
06cad0b
a657f7e
aa5e009
hexagon: improved GELU accuracy (#30104)
kurquhar committed 1 month ago
7081510
chat: fix jinja parser for TranslateGemma (#30096)
Nicolas Budyn committed 1 month ago
bd4eeaa
model : add LiquidAI/d1-3B decision model (#30110)
Tarek Dakhran committed 1 month ago
88dcc46
b86d2f0
mtmd: add cohere2 vision support (#30062)
Terrence Zhao committed 1 month ago
50a6c5c
9881906