Skip to content

Get up and running with Kimi, GLM, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.

Commits on main

llama: update to commit 71e90e88 (#10192)
Jeffrey Morgan committed 1 year ago
943464c
Integration test improvements (#9654)
Daniel Hiltgen committed 1 year ago
ed4e139
Give tests more time to run (#10306)
Daniel Hiltgen committed 1 year ago
56dc316
fix write gguf padding
Michael Yang committed 1 year ago
2fec73e
cmd: add retry/backoff (#10069)
Blake Mizerany committed 1 year ago
1e7f62c
ccb7eb8
0fe487e
docs: update some response code blocks to json5
Devon Rifkin committed 1 year ago
378d321
server: add `OpenAI-Beta` header to CORS safelist
Devon Rifkin committed 1 year ago
97fe45e
64a9cc8
ggml: Fix memory leak on input tensors
Jesse Gross committed 1 year ago
f50d691
34c3b68
ggml: Use pointer receivers for Context
Jesse Gross committed 1 year ago
f33ccd5
ggml: Log filesystem errors
Jesse Gross committed 1 year ago
bc108b9
Fix dockerfile. (#9855)
湛露先生 committed 1 year ago
5c0331f
kvcache: stub out test structs
Michael Yang committed 1 year ago
d98bfe7
dbb149e
ggml: Check for OOM and return as Go errors
Jesse Gross committed 1 year ago
a807985
b0c3aba