Apache Lucene open-source search software
docs: move Thai improvements to 10.6
Robert Muirbe64d0652651
diff --git a/lucene/CHANGES.txt b/lucene/CHANGES.txtindex 4d0c74d2cbc..531fa28435f 100644--- a/lucene/CHANGES.txt+++ b/lucene/CHANGES.txt@@ -123,16 +123,6 @@ API ChangesNew Features----------------------* GITHUB#16722: Support user dictionary in ThaiTokenizer and ThaiTokenizerFactory.- (Kamthorn Krairaksa)--* GITHUB#16717: Add ThaiCharFilter, ThaiCharFilterFactory, and ThaiNormalizationFilter for- pre-tokenization character normalization and token-level normalization in ThaiAnalyzer.- (Kamthorn Krairaksa)--* GITHUB#16720: Add ThaiRepeatFilter and ThaiRepeatFilterFactory to expand Thai repetition- mark (Maiyamok) with exact OffsetAttribute and highlighter compatibility. (Kamthorn Krairaksa)-* GITHUB#16241: Add HangulCompositionCharFilter to analysis-nori for opt-in composition ofmodern Hangul conjoining jamo before KoreanTokenizer. (Mingi Jeong)@@ -155,9 +145,6 @@ New FeaturesImprovements----------------------* GITHUB#16718: Modernize ThaiAnalyzer default stopwords list based on contemporary Thai corpus- frequency analysis and linguistically validated stop words. (Kamthorn Krairaksa)-* GITHUB#15704: Replace LinkedList with more efficient data structure. (Renato Haeberli)* GITHUB#15682: Use ArrayDeque instead of LinkedList in CompoundWordTokenFilterBase.java. (Renato Haeberli)@@ -231,8 +218,6 @@ OptimizationsBug Fixes----------------------* GITHUB#10153: Allow configurable buffer size in SegmentingTokenizerBase and recognize whitespace as safe boundary in ThaiTokenizer to avoid splitting words across buffer boundaries. (Kamthorn Krairaksa)-* GITHUB#16553: Fix stored-fields corruption when PerField#finish throws: the stored-fields framewas left open, causing "Wrote N docs, finish called with numDocs=M" at flush. (Michael Marshall)@@ -399,6 +384,15 @@ API ChangesNew Features---------------------+* GITHUB#16722: Support user dictionary in ThaiTokenizer and ThaiTokenizerFactory.+ (Kamthorn Krairaksa)++* GITHUB#16717: Add ThaiCharFilter, ThaiCharFilterFactory, and ThaiNormalizationFilter for+ pre-tokenization character normalization and token-level normalization in ThaiAnalyzer.+ (Kamthorn Krairaksa)++* GITHUB#16720: Add ThaiRepeatFilter and ThaiRepeatFilterFactory to expand Thai repetition+ mark (Maiyamok) with exact OffsetAttribute and highlighter compatibility. (Kamthorn Krairaksa)* GITHUB#16680: Add a "subword" type to the subword tokens generated bythe compound word token filters, so downstream filters can distinguish@@ -434,6 +428,8 @@ New FeaturesImprovements---------------------+* GITHUB#16718: Modernize ThaiAnalyzer default stopwords list based on contemporary Thai corpus+ frequency analysis and linguistically validated stop words. (Kamthorn Krairaksa)* GITHUB#16298: Store doc values DISI data into a separate file. (Sagar Upadhyaya)@@ -557,6 +553,7 @@ OptimizationsBug Fixes---------------------+* GITHUB#10153: Allow configurable buffer size in SegmentingTokenizerBase and recognize whitespace as safe boundary in ThaiTokenizer to avoid splitting words across buffer boundaries. (Kamthorn Krairaksa)* GITHUB#16620: Make HNSW merges abortable during graph initialization and repair, so that thecopy, repair and rebalance phases of an initialized graph build can be promptly aborted when the