Skip to content

LLM inference in C/C++

C++ ggml

Commits on master

model: add DSpark support for Nemotron3.5 (#27804)
Ruixiang Wang committed 2 months ago
ca3d5a3
e70802a
1844325
model: add Qwen3.8-Flash-Next (qwen4exp) (#27742)
Daniel Han committed 2 months ago
6c84c7d
6fdd0ac
1a946ec
llama: model_loader: add TENSOR_READ_LAZY (#27794)
Xuan-Son Nguyen committed 2 months ago
fac889f
convert : fix Nemotron-H LoRA GGUF conversion (#27356)
Kartik Gulia committed 2 months ago
bcb6084
model : simplify MiniMax-01 graph (#27790)
fairydreaming committed 2 months ago
deae5ee
args: add --video-* CLI arguments (#24318)
Xuan-Son Nguyen committed 2 months ago
f295512
915dc6d
llama : add --n-cpu-ffn option (#26622)
Jonas J committed 2 months ago
c5fc7e3
models : support nanbeige4.2-3B (#27730)
zql committed 2 months ago
d7a2074
llama: add token ID tracking to KV cell (#27762)
Xuan-Son Nguyen committed 2 months ago
925e117
539f245
ui: Update Dialog component styling (#27743)
Aleksander Grygier committed 2 months ago
0379a19
rpc : implement event and async backend APIs (#18626)
Radoslav Gerganov committed 2 months ago
d0132a6
ci: Clean up UI builds from releases (#27706)
Aleksander Grygier committed 2 months ago
4d19b28