Skip to content

LLM inference in C/C++

C++ ggml
282 B
Raw Blame

llama.cpp/examples/speculative

Demonstration of speculative decoding and tree-based speculative decoding techniques

More info: