Skip to content

LLM inference in C/C++

C++ ggml

Commits on master

metal : add repeat bf16 (#24638)
Georgi Gerganov committed 5 months ago
272088b
chat: fix whitespace problems once and for all (#24624)
Piotr Wilkin (ilintar) committed 5 months ago
a6dff71
UI/svg block rendering (#24080)
Pascal committed 5 months ago
2a6c391
3686e9d
convert : fix lora base model arch retrieval (#24621)
Sigbjørn Skjæret committed 5 months ago
dd4623a
ui: Add HEIC/HEIF image support (#24137)
Nicolas Mowen committed 5 months ago
5f04dc7
chat: add dedicated Cohere2MoE (North Code) parser (#24615)
Piotr Wilkin (ilintar) committed 5 months ago
aedb2a5
8edaca9
docker: specify registry to simplify Podman builds (#24607)
Alexander Batischev committed 5 months ago
20c5266
fd5869f
jinja : add count/d/e filter aliases (#24606)
Sigbjørn Skjæret committed 5 months ago
acd79d6
cli : fix not copying preserved tokens (#24258)
Michael Wand committed 5 months ago
6e14286
8ed274e
ci : use CUDA label for cuda backend (#24594)
Sigbjørn Skjæret committed 5 months ago
4672211
add sycl to check-release (#24583)
Sigbjørn Skjæret committed 5 months ago
c2ba3e4
53bd47e
Add arch support for cohere2-MoE (#24260)
Michael Wand committed 5 months ago
4988f6e
jinja : fix negative step slice with start/stop values (#24580)
Sigbjørn Skjæret committed 5 months ago
f05cf46
ui: build-time gzip compression (#24571)
Xuan-Son Nguyen committed 5 months ago
e8067a8
jinja : fix split and replace with empty first arg (#24574)
Sigbjørn Skjæret committed 5 months ago
341babc
vulkan: support non-contig unary/glu ops (#24215)
Jeff Bolz committed 5 months ago
1a7718b
ui: keep original file name and path (#24568)
Xuan-Son Nguyen committed 5 months ago
597b667
server: clean up static assets handling (#24550)
Xuan-Son Nguyen committed 5 months ago
57fe1f0
fit : wrap llama_device_memory_data (#24522)
Georgi Gerganov committed 5 months ago
d8a24cc
fix sycl links in release notes (#24527)
Muhammad Salem committed 5 months ago
c34b922
mtmd: add batching API (#24384)
Xuan-Son Nguyen committed 5 months ago
e37abd6
ci : unbreak release harder (#24545)
Sigbjørn Skjæret committed 5 months ago
f58bad4