LLM inference in C/C++
C++ ggml
Commits on master
mtmd: support MiMo-V2.5 audio input (RVQ-based model) (#26190)
1cbfd19 Xuan-Son Nguyen committed 3 months ago
common : add common_print_available_devices() (#26170)
0e4a036 Adrien Gallouët committed 3 months ago
fit : count nextn (MTP) blocks in n_gpu_layers so front layers stay on GPU (#26177)
0324696 Jonas Jankaitis committed 3 months ago
ggml : adjust logic for offloading ops to weight's backend (#25832)
dee2a84 Georgi Gerganov committed 3 months ago
tests : remove unnecessary sync in test-save-load-state (#26166)
7ef790f Georgi Gerganov committed 3 months ago
common: fix explicit -md precedence over draft sidecar resolution (#26165)
ddfc228 Pascal committed 3 months ago
ggml-cpu: Enable BF16 tiled gemm optimization on PowerPC (#26068)
b910200 shalinib-ibm committed 3 months ago
args: add `-lm mlock` where it mlocks but doesnt mmap (#26135)
ad256de Aaron Teo committed 3 months ago
server + ui: fix stream routes for model names containing a slash (#26137)
d73c1d6 Pascal committed 3 months ago
ui: fix system message edit box not expanding to fit content (#26006)
d4d057b Piero Evangelista committed 3 months ago
Keep Minimax's indexer tensors at F32 for speed and accuracy (#26144)
7657a6c Bartowski committed 3 months ago
ui: detect the conversation import format from file contents (#26121)
55b7d6c Pascal committed 3 months ago
common: add `subproc.h` wrapper, disabled on android/ios (#26102)
d2a8182 Xuan-Son Nguyen committed 3 months ago
model: Add MiniMax-M3 (MSA: MiniMax Sparse Attention) support (#24908)
b1d4c65 timkhronos committed 3 months ago
ui: fix context gauge card regressions and land at the conversation end (#26099)
ff067f7 Pascal committed 3 months ago
common : use-after-free when loading LoRA adapter fails (#25611)
8bb9093 Nicky Mouha committed 3 months ago
common : skip empty implicit default preset (#25643)
c812c54 hogeheer499-commits committed 3 months ago
server : add missing task parameters(adaptive_target, adaptive_decay) in generation_settings (#25830)
2cfc767 Tekin Ertekin committed 3 months ago