LLM inference in C/C++
C++ ggml
Commits on master
Update ggml/src/gguf.cpp : Defined virtual keyword for destructor of gguf_writer_base (#25867)
fb92d8f Yongmin Yoo 유용민 committed 3 months ago
common : add support for multiple end sequences in the reasoning budget sampler (#25544)
910196f Aldehir Rojas committed 3 months ago
ui: fix MCP server display name conflicts in tools lists (#26011)
95a923a Pascal committed 3 months ago
server: support "reasoning_effort": "none" in OAI API (#26045)
27209a5 Nigel Bosch committed 3 months ago
opencl: cache compiled cl_program binaries on disk (#26050)
ed7adbf Hongqiang Wang committed 3 months ago
opencl: do not treat NULL-mask flash attention as causal (#25771)
56a8386 kumaal committed 3 months ago
skill: create `add-new-model` and `code-review` (#26042)
77095ee Xuan-Son Nguyen committed 3 months ago
UI: Fix settings precedence, Factory < Admin (--ui-config-file) < Users (Settings panel) (#26002)
54ce507 Pascal committed 3 months ago
cohere2 moe template parser: enforce JSON schema for text responses if a response schema is provided (#26018)
8f5ab83 Matt Thompson committed 3 months ago
hexagon: further improved pipeline of the core bits (L2, DMA, MM, FA) (#26049)
0a50d99 Max Krasnyansky committed 3 months ago
hexagon: fix Windows crash when op_poll is enabled (#26029)
c0bc859 adgup-qti committed 3 months ago
contrib: fix leftovers from the AI usage policy update (#26030)
da296d6 Pascal committed 4 months ago
conversion: fix non-MoE NomicBert GGUF conversion error (#25996)
d941f6e Shahir BIn Zulfiker committed 4 months ago
contrib: allow all AI-generated code in general (#26012)
4310aa4 Xuan-Son Nguyen committed 4 months ago
ui: Add a "Default" option for the reasoning selector (#25846)
cf51256 Pascal committed 4 months ago
CUDA: Improve NVFP4 W4A4 activation quantization (#25730)
1a064ab Oliver Simons committed 4 months ago
mtmd: use RAII for setting and resetting non-causal attention (#25723)
e0833bf Niklas Wenzel committed 4 months ago
feat(ui): add symbolic math support to JS sandbox via nerdamer (#25948)
61328e6 rankaiyx committed 4 months ago