Skip to content

LLM inference in C/C++

C++ ggml

Commits on master

3d93885
2bacf9e
common: apply CPU parameters across tools (#27026)
Niklas Wenzel committed 3 months ago
a94d563
bdffafa
refactor: Naming (#27001)
Aleksander Grygier committed 3 months ago
fa4ec45
2606220
server : serve index.html with no-cache (#27006)
Emanuil Rusev committed 3 months ago
981184e
spec : auto-detect mtp draft model type (#27005)
Sigbjørn Skjæret committed 3 months ago
1d2869c
metal : add TQ2_0 support (#26980)
Georgi Gerganov committed 3 months ago
4a84b0a
0d0bfcd
sycl: fuse UNARY(silu|sigmoid|softplus) + MUL (#26411)
Titaniumtown committed 3 months ago
1ee1cd9
sycl : Add DMMV ESIMD Q3_K kernel (#26251)
Todd Malsbary committed 3 months ago
8efbf65
server: refactor + correctness fixes for metrics (#26920)
Xuan-Son Nguyen committed 3 months ago
decaf50
e79e4bf
ui: Move `styles/` to `$lib` scope (#26950)
Aleksander Grygier committed 3 months ago
f2efd64
ui: Stores architecture improvements (#26910)
Aleksander Grygier committed 3 months ago
094e53d
refactor: Clean up UI types (#26909)
Aleksander Grygier committed 3 months ago
a6040c9
ggml : fix arm builds, unused var (#26991)
Georgi Gerganov committed 3 months ago
1f368f3
ui: Constants refactor (#26908)
Aleksander Grygier committed 3 months ago
e21152d
common: add system-level config file (#26118)
Johnathan Craig Maudlin committed 3 months ago
8e7f22b
84e908c
ci : disable ubuntu-rocm (#26969)
Sigbjørn Skjæret committed 3 months ago
9558fa4