Skip to content

LLM inference in C/C++

C++ ggml

grammar : fix max repetition threshold (#28469)

Aldehir Rojas9e0e220594af
diff --git a/src/llama-grammar.cpp b/src/llama-grammar.cpp
index f14215ac7e..6aa03c7666 100644
--- a/src/llama-grammar.cpp
+++ b/src/llama-grammar.cpp
@@ -492,7 +492,7 @@ const char * llama_grammar_parser::parse_sequence(
total_rules = min_times;
}
- if (n_prev_rules * total_rules >= MAX_REPETITION_THRESHOLD) {
+ if (n_prev_rules * total_rules > MAX_REPETITION_THRESHOLD) {
throw std::runtime_error("number of rules that are going to be repeated multiplied by the new repetition exceeds sane defaults, please reduce the number of repetitions or rule complexity");
}