Skip to content

LLM inference in C/C++

C++ ggml

Commits on master

ggml-cpu: Enable tiled matmul on AIX (#25199)
shalinib-ibm committed 4 months ago
3b4fca1
86961ef
d80e878
scripts : use HF_TOKEN when downloading UI assets (#25280)
Adrien Gallouët committed 4 months ago
4871961
d06ddd3
ui: fake 200 for proxy DELETE req (#25298)
Xuan-Son Nguyen committed 4 months ago
898b088
72874f5
abort if we see a multi buffer (#25276)
Eve committed 4 months ago
3e5036f
78d2f52
ui: Improve performance when streaming (#25225)
Nick Towle committed 4 months ago
d4cff11
spec: support spec-draft-p-min in DFlash (#25246)
Ruixiang Wang committed 4 months ago
152d337
cuda: enable topk-moe fusion for 288 experts (#25267)
Piotr Wilkin (ilintar) committed 4 months ago
75a48a9
ui: Add MCP Servers Opt-In for first time visitors (#25239)
Aleksander Grygier committed 4 months ago
9487528
5a460de
vendor : update cpp-httplib to 0.49.0 (#25218)
Alessandro de Oliveira Faria (A.K.A.CABELO) committed 4 months ago
c8ae9a7
llama : add llama_model_ftype_name() (#25134)
Adrien Gallouët committed 4 months ago
fdb1db8
common : use hf primary split as model path (#25194)
Adrien Gallouët committed 4 months ago
a6647b1
CUDA: consistent use of __restrict__ + PDL for FA (#25185)
Johannes Gäßler committed 4 months ago
b820cc8