Skip to content

Get up and running with Kimi, GLM, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.

Commits on main

ggml: Seperate tensor load from backend creation
Jesse Gross committed 1 year ago
94ab428
d755577
llm: Consistently track unassigned model data
Jesse Gross committed 1 year ago
a2cc857
7edfdd2
model: handle multiple eos tokens (#10577)
Michael Yang committed 1 year ago
333e360
Fix lingering Q4_0 help reference (#10720)
Daniel Hiltgen committed 1 year ago
27da2cd
cmd: add ellipses to truncated show metadata (#10717)
Bruce MacDonald committed 1 year ago
feb8923
ollamarunner: Multi-modal worst case graph
Jesse Gross committed 1 year ago
fe623c2
ollamarunner: Separate text and multimodal graphs
Jesse Gross committed 1 year ago
3c14461
499ae73
fix pixel values padding (#10718)
Michael Yang committed 1 year ago
ef20278
fix mllama conversion (#10716)
Michael Yang committed 1 year ago
5576019
ggml: update qwen25vl vision size estimate (#10711)
Bruce MacDonald committed 1 year ago
bd68d3a
ff80718
model: add Qwen2.5-VL support (#10385)
Bruce MacDonald committed 1 year ago
0aa8b37
chore: update mllama to use ollama engine (#10637)
Michael Yang committed 1 year ago
2312564
llama: fix memory leak for grammar (#10696)
Parth Sareen committed 1 year ago
8cc33f4
Revert "remove cuda v11 (#10569)" (#10692)
Daniel Hiltgen committed 1 year ago
c6bcdc4
llama: fix crash on snowflake embedding model (#10690)
Jeffrey Morgan committed 1 year ago
4b903f0
server: add webp image input support (#10653)
Jeffrey Morgan committed 1 year ago
c7f4ae7
fix vocabulary (#10679)
Michael Yang committed 1 year ago
526b2ed
models: remove unused qwen2vl processing (#10677)
Bruce MacDonald committed 1 year ago
a7240c6
Follow up to #10363 (#10647)
Daniel Hiltgen committed 1 year ago
9d6df90
llama: update to commit de4c07f93 (#10655)
Jeffrey Morgan committed 1 year ago
0cefd46
convert: quantize from safetensors needs kv (#10675)
Bruce MacDonald committed 1 year ago
ad035ad
feat: add trace log level (#10650)
Michael Yang committed 1 year ago
f95a1f2