LLM inference in C/C++
C++ ggml
Commits on master
server: improve user message detection and create checkpoints at every user message (#24176)
73618f2 Aldehir Rojas committed 5 months ago
ui: Prioritize favorite models in model selection (#24766)
9c0ac88 Mahdiou Diallo committed 5 months ago
server: (router) move model downloading to dedicated process (#24834)
721354f Xuan-Son Nguyen committed 5 months ago
server: refactor/generalize input file schema (#24299)
6ee0f65 Xuan-Son Nguyen committed 5 months ago
ui: model status and load progress via /models/sse feed (#24878)
099b579 Pascal committed 5 months ago
sampling : remove unconditional softmax+sort in top-n-sigma sampler (#22645)
37957e8 Tim Neumann committed 5 months ago
server: fix edit_file crash on append at end of file (line_start -1) (#24893)
d0f9d2e Pascal committed 5 months ago
docs/android.md: Add dependency `libandroid-spawn` for building in termux (#21812)
0ef6f06 aafsmarak committed 5 months ago
common/peg : implement ac parser for stricter grammar generation (#24869)
52b3df0 Aldehir Rojas committed 5 months ago
server: fix report progress for loading spec models, add "stages" list (#24870)
7c082bc Xuan-Son Nguyen committed 5 months ago
server: real-time model load progress tracking via /models/sse (#24828)
d6d8995 Xuan-Son Nguyen committed 5 months ago
common/peg : refactor until gbnf grammar generation (#24839)
063d9c1 Aldehir Rojas committed 5 months ago
common/json-schema-to-grammar : align spacing rules with parsers (#24835)
c576070 Aldehir Rojas committed 5 months ago
fix(hexagon): use padded stride for ssm-conv weights (#24470)
4a80943 Guanhuai Zhang committed 5 months ago
llama : use LLM_KV for quantization_version & file_type (#24802)
84de01a Adrien Gallouët committed 5 months ago
arg: try fixing test-args-parser randomly fails (#24826)
75f460a Xuan-Son Nguyen committed 5 months ago
release: add missing link for win opencl adreno arm64 (#24809)
8452824 Muhammad Salem committed 5 months ago
docker : prebuild web UI for s390x build [no release] (#24829)
67e9fd3 Aldehir Rojas committed 5 months ago
model : glm-dsa load DSA indexer tensors as optional (#24770)
796f41b davidrhodus committed 5 months ago