Method CreateComponents
CreateComponents(String, TextReader, String)
Creates a token stream that tokenizes the given string into token terms (aka words).
Declaration
public TokenStreamComponents CreateComponents(string fieldName, TextReader reader, string text)Parameters
| Type | Name | Description |
|---|---|---|
| System.String | fieldName | the name of the field to tokenize (currently ignored). |
| System.IO.TextReader | reader | reader (e.g. charfilter) of the original text. can be null. |
| System.String | text | the string to tokenize |
Returns
| Type | Description |
|---|---|
| TokenStreamComponents | a new token stream |
CreateComponents(String, TextReader)
Creates a token stream that tokenizes all the text in the given SetReader; This implementation forwards to Lucene.Net.Analysis.Analyzer.GetTokenStream(System.String, System.IO.TextReader) and is less efficient than Lucene.Net.Analysis.Analyzer.GetTokenStream(System.String, System.IO.TextReader).
Declaration
protected override TokenStreamComponents CreateComponents(string fieldName, TextReader reader)Parameters
| Type | Name | Description |
|---|---|---|
| System.String | fieldName | the name of the field to tokenize (currently ignored). |
| System.IO.TextReader | reader | the reader delivering the text |
Returns
| Type | Description |
|---|---|
| TokenStreamComponents | a new token stream |
Overrides
Lucene.Net.Analysis.Analyzer.CreateComponents(System.String, System.IO.TextReader)
