Skip to content

LLM inference in C/C++

C++ ggml

Commits on master

c50b34a
96278e3
9bd4c09
server: (tools) add x-tool-cwd header (#26420)
Xuan-Son Nguyen committed 3 months ago
f2b52a8
model: MTP support for Qwen3-Next (#25589)
Masashi Yoshimura committed 3 months ago
4ed2b13
llama : MTP support for DeepSeek V3.2 (#26457)
fairydreaming committed 3 months ago
2b63e06
metal: implement DSv4 Lightning Indexer (#25893)
Thiago Padilha committed 3 months ago
1464c62
metal : add SILU_BACK (#25982)
Talha Adnan committed 3 months ago
221f0f6
metal : add F16 support for bin ops (#26465)
Georgi Gerganov committed 3 months ago
9d21b57
0ab9d6f
metal: implement DeepSeek V4 hyper-connections (#26459)
Georgi Gerganov committed 3 months ago
fffbcbd
bb4e0e1
3581ba0
DeepseekV4 MTP + DSpark (#25784)
Aman Gupta committed 3 months ago
596a579
chat : add qwen3 specialized parser (#26252)
Aldehir Rojas committed 3 months ago
f5919bf
sycl: fix classification of iGPUs (#26105)
KyleHagy committed 3 months ago
272700b
model : load MiMo V2 MTP tensors only if used (#26412)
Sigbjørn Skjæret committed 3 months ago
75587a0
ggml-webgpu: add support for f16 repeat (#26307)
Masashi Yoshimura committed 3 months ago
7a2db1a
test: fix some CI errors (#26415)
Xuan-Son Nguyen committed 3 months ago
11924d4
vendor : update BoringSSL to 0.20260730.0 (#26353)
Alessandro de Oliveira Faria (A.K.A.CABELO) committed 3 months ago
815a2a5
agents: clarify comment style and jinja knowledge (#26405)
Xuan-Son Nguyen committed 3 months ago
89482bd
mtmd: add minicpmv46 downsample (#25993)
tc-mb committed 3 months ago
de69995
chat : enable tool call in thinking for DS4 (#26269)
Piotr Wilkin (ilintar) committed 3 months ago
ddd4ec1
vulkan: add POOL_1D op (#25431)
Anand Patil committed 3 months ago
876a432