Constructor CharTokenizer
CharTokenizer(LuceneVersion, TextReader)
Creates a new CharTokenizer instance
Declaration
public CharTokenizer(LuceneVersion matchVersion, TextReader input)
Parameters
Type | Name | Description |
---|---|---|
LuceneVersion | matchVersion | Lucene version to match |
System.IO.TextReader | input | the input to split up into tokens |
CharTokenizer(LuceneVersion, AttributeSource.AttributeFactory, TextReader)
Creates a new CharTokenizer instance
Declaration
public CharTokenizer(LuceneVersion matchVersion, AttributeSource.AttributeFactory factory, TextReader input)
Parameters
Type | Name | Description |
---|---|---|
LuceneVersion | matchVersion | Lucene version to match |
AttributeSource.AttributeFactory | factory | the attribute factory to use for this Tokenizer |
System.IO.TextReader | input | the input to split up into tokens |