Skip to content

LLM inference in C/C++

C++ ggml

Commits on master

Deepseek 4: `-sm tensor` (#26490)
Aman Gupta committed 2 months ago
bf0a29c
model : support MTP in GLM-4.5-Air (#26534)
jacekpoplawski committed 2 months ago
c060ca9
readme : update links (#27617)
Georgi Gerganov committed 2 months ago
ccc8fd2
fix: Change chat tabs nav shortcuts (#27609)
Aleksander Grygier committed 2 months ago
d05f895
test : fix multi-GPU server tests (#27614)
Georgi Gerganov committed 2 months ago
8d9af25
test: move tools/parser to tests (#27548)
Xuan-Son Nguyen committed 2 months ago
4a08fa2
ci : add test-llama-archs tensor split for Metal (#27598)
Georgi Gerganov committed 2 months ago
95b8e33
a278dce
server : add LLAMA_SERVER_SLOTS_N_DIFF (#27600)
Georgi Gerganov committed 2 months ago
e8eed45
DeepseekV4: fix rollback with multi-seq (#26756)
Aman Gupta committed 2 months ago
b0539c4
ui: Chat Conversation Tabbed navigation (#27263)
Aleksander Grygier committed 2 months ago
8144f31
vendor : update subprocess.h (#27409)
Alessandro de Oliveira Faria (A.K.A.CABELO) committed 2 months ago
6657ded
cuda : add POOL_1D support (#27573)
Aman Karki committed 2 months ago
29ea941
common: json.h: fix clang lto (#27575)
Xuan-Son Nguyen committed 2 months ago
70adb1b
3f545be
mtmd: use ggml_rope_set_offset (#27521)
Xuan-Son Nguyen committed 2 months ago
b21e4de
common: add json.h abstraction (#27511)
Xuan-Son Nguyen committed 2 months ago
d9f918d
fit: also take into account n_streams (#27496)
Xuan-Son Nguyen committed 2 months ago
2fb989b
arg: remove -no-cnv from cli [no ci] (#27542)
Xuan-Son Nguyen committed 2 months ago
9fee29e
ci : Restore ROCm job for Ubuntu (#27399)
Mario Limonciello committed 3 months ago
e85caa8
model : support DSpark for bailingmoe3 (#27508)
Tiwei Bie committed 3 months ago
2115b73
mtmd: support dots3-note vision+audio (#27524)
Xuan-Son Nguyen committed 3 months ago
54ee5ee
3a653fe
common : fix draft-mtp with embeddings (#26352, #27299) (#27400)
Shahir BIn Zulfiker committed 3 months ago
2c6b141
8672290