Class ThaiTokenizer
Tokenizer that use BreakIterator to tokenize Thai text.
Inheritance
System.Object
ThaiTokenizer
Inherited Members
Lucene.Net.Analysis.Tokenizer.SetReader(System.IO.TextReader)
Assembly: Lucene.Net.ICU.dll
Syntax
public class ThaiTokenizer : SegmentingTokenizerBase, IDisposableConstructors
| Name | Description |
|---|---|
| ThaiTokenizer(AttributeSource.AttributeFactory, TextReader) | Creates a new ThaiTokenizer, supplying the AttributeSource.AttributeFactory |
| ThaiTokenizer(TextReader) | Creates a new ThaiTokenizer |
Fields
| Name | Description |
|---|---|
| DBBI_AVAILABLE | True if the JRE supports a working dictionary-based breakiterator for Thai. If this is false, this tokenizer will not work at all! |
Methods
| Name | Description |
|---|---|
| IncrementWord() | |
| SetNextSentence(Int32, Int32) |
