LLM inference in C/C++
C++ ggml
grammar : fix max repetition threshold (#28469)
Aldehir Rojas9e0e220594af
diff --git a/src/llama-grammar.cpp b/src/llama-grammar.cppindex f14215ac7e..6aa03c7666 100644--- a/src/llama-grammar.cpp+++ b/src/llama-grammar.cpp@@ -492,7 +492,7 @@ const char * llama_grammar_parser::parse_sequence(total_rules = min_times;}- if (n_prev_rules * total_rules >= MAX_REPETITION_THRESHOLD) {+ if (n_prev_rules * total_rules > MAX_REPETITION_THRESHOLD) {throw std::runtime_error("number of rules that are going to be repeated multiplied by the new repetition exceeds sane defaults, please reduce the number of repetitions or rule complexity");}