Method CreateComponents
CreateComponents(String, TextReader)
Creates
TokenStreamComponents
used to tokenize all the text in the provided
Declaration
protected override TokenStreamComponents CreateComponents(string fieldName, TextReader reader)
Parameters
Type | Name | Description |
---|---|---|
System.String | fieldName | |
TextReader | reader |
Returns
Type | Description |
---|---|
TokenStreamComponents | TokenStreamComponents built from a StandardTokenizer filtered with StandardFilter, LowerCaseFilter, ThaiWordFilter, and StopFilter |