Skip to content

LLM inference in C/C++

C++ ggml

Commits on master

qwen35: use post-norm hidden state for MTP (#24025)
Aman Gupta committed 5 months ago
166fe29
c8d6a00
mtmd, model: allow skip build_vit() (#24077)
Xuan-Son Nguyen committed 5 months ago
a731805
ui: Mermaid Diagrams in chat + interactive preview (#24032)
Aleksander Grygier committed 5 months ago
ee4cf70
ggml-cpu: use runtime SVE width in FWHT (#24059)
Charles Xu committed 5 months ago
3571fa5
tests : add support for qwen3 SSM archs (#24031)
Georgi Gerganov committed 5 months ago
06938ac
update BoringSSL to 0.20260526.0 (#23794)
Alessandro de Oliveira Faria (A.K.A.CABELO) committed 5 months ago
d545a2a
ci : disable ccache for msvc windows release jobs (#23911)
Georgi Gerganov committed 5 months ago
4da6370
hexagon: profiler output fix and script updates (#24042)
Max Krasnyansky committed 5 months ago
5c394fd
model: add Mellum architecture (#23966)
Mikhail Podvitskii committed 5 months ago
4fb16ec
StepFun 3.5 MTP (#23274)
Piotr Wilkin (ilintar) committed 5 months ago
2187e00
0b71540
server: add SSE ping interval (#24013)
Xuan-Son Nguyen committed 5 months ago
60130d1
ci : reduce self-hosted server workflow jobs (#24012)
Georgi Gerganov committed 5 months ago
a468b89
docs : update HOWTO-add-model.md (#23883)
Mikhail Podvitskii committed 5 months ago
d5ab083
ui: simplify network error handling (#23431)
Marcos Del Sol Vives committed 5 months ago
69cea5b
2365315
convert : support Step3.7-Flash (#23845)
forforever73 committed 5 months ago
f7a0777
llama : deprecate `llama_set_warmup` (#24009)
Georgi Gerganov committed 5 months ago
4f3a4be
hexagon: add gelu_quick (#24007)
Todor Boinovski committed 5 months ago
d178a11
clean up unused variables warnings (#23975)
Anav Prasad committed 5 months ago
1fd5f48