Skip to content

LLM inference in C/C++

C++ ggml

Commits on master

7221e24
ci : add release attestation url (#27389)
Sigbjørn Skjæret committed 3 months ago
01ac3ad
models : remove duplicate metadata load (#27378)
Sigbjørn Skjæret committed 3 months ago
2e92ecd
ci : re-enable release dependency for sycl (#27385)
Sigbjørn Skjæret committed 3 months ago
645ca28
ggml: add ggml_rope_set_offset (+ metal support) (#27120)
Xuan-Son Nguyen committed 3 months ago
fe8156f
mtmd: add mtmd_bitmap_set_mergeable (#27348)
Xuan-Son Nguyen committed 3 months ago
95c409c
metal : dequantize q8_0 using packed types (#27370)
Georgi Gerganov committed 3 months ago
8ef78e6
server: add dedup-cache-models preset option (#27346)
Xuan-Son Nguyen committed 3 months ago
ee4c505
98d1e92
0adcc3b
gguf-py : add size guards to GGUFReader (#27188)
Oğuzhan Akkaya committed 3 months ago
0329fcd
ui: Services consolidation refactor (#27239)
Aleksander Grygier committed 3 months ago
3dc7285
ui: Stores consolidation refactor (#27238)
Aleksander Grygier committed 3 months ago
fdf4c64
04b5691
sycl: honor GGML_HINT_SRC0_IS_HADAMARD (#27298)
Titaniumtown committed 3 months ago
0882c7b
unicode : include '~' in collapsed symbol class (#26972)
Thiago Padilha committed 3 months ago
afd439d
readme : update status badges + regen AUTHORS (#27317)
Georgi Gerganov committed 3 months ago
169e4a7
c029602
mtmd: fix LFM2 image tiling threshold (#27057)
BlackFoil committed 3 months ago
7acdbb1