LLM inference in C/C++
C++ ggml
Commits on master
ci : create pre-release with change log and nightly link in make-release (#27302)
8b86400 Georgi Gerganov committed 3 months ago
CUDA: MMVQ nwarps=8 for bs=1 for dense models on DGX Spark (#26843)
25ae3a9 ynankani committed 3 months ago
ui: enforce alphabetical enum member ordering (#27272)
01818e4 Aleksander Grygier committed 3 months ago
ui: Refactor Built-In Tools naming (Server/Browser) (#27271)
0021a77 Aleksander Grygier committed 3 months ago
doc: document MCP stdio servers and CORS defaults in the server README [no release] [no ci] (#26847)
087f94d Pascal committed 3 months ago
server: save processed mtmd chunks as placeholder (#27278)
533b182 Xuan-Son Nguyen committed 3 months ago
mtmd : skip thumbnail for non-tiled LFM2 images (#27246)
b75ecd1 Tarek Dakhran committed 3 months ago
ci : push release tag explicitly in release.yml (#27261)
34af94c Georgi Gerganov committed 3 months ago
model: support speculators-format checkpoints for DSpark (#26275)
9cd719a 王金旭 committed 3 months ago
ci : restore release.yml check during make-release.yml (#27247)
d83f72d Georgi Gerganov committed 3 months ago
ci : allow make-release to target a specific commit (#27234)
7c35571 Georgi Gerganov committed 3 months ago
ci : make release workflows use a deploy key (#27229)
f9779dd Georgi Gerganov committed 3 months ago
llama-bench: fix deprecation warnings missing trailing newline (#27179)
4695f00 Fathi Boudra committed 3 months ago
sycl: fix thread/block count in quantized cpy kernel launches (#27160)
f275595 Titaniumtown committed 3 months ago