Skip to content

RAGFlow is an agent-native database: a Retrieval-Augmented Generation (RAG) engine that grew into context infrastructure.

fix(tokenizer): let the SSE2 loops in ToLower run (#21436)

CCLUCKYf9ff41ebdd3c
diff --git a/internal/binding/cpp/string_utils.h b/internal/binding/cpp/string_utils.h
index c651071734..e02654a7ea 100644
--- a/internal/binding/cpp/string_utils.h
+++ b/internal/binding/cpp/string_utils.h
@@ -98,7 +98,7 @@ inline std::string ToLowerString(std::string_view s)
const auto a_minus1 = _mm_set1_epi8('A' - 1);
const auto z_plus1 = _mm_set1_epi8('Z' + 1);
const auto delta = _mm_set1_epi8('a' - 'A');
- for (; p > sse2_end; p += SSE2_BYTES)
+ for (; p < sse2_end; p += SSE2_BYTES)
{
auto bytes = _mm_loadu_si128((const __m128i*)p);
_mm_maskmoveu_si128(_mm_xor_si128(bytes, delta),