Constructor WhitespaceTokenizer
WhitespaceTokenizer(LuceneVersion, TextReader)
Declaration
public WhitespaceTokenizer(LuceneVersion matchVersion, TextReader in)
Parameters
Type | Name | Description |
---|---|---|
LuceneVersion | matchVersion | LuceneVersion to match |
System.IO.TextReader | in | the input to split up into tokens |
WhitespaceTokenizer(LuceneVersion, AttributeSource.AttributeFactory, TextReader)
Construct a new WhitespaceTokenizer using a given AttributeSource.AttributeFactory.
Declaration
public WhitespaceTokenizer(LuceneVersion matchVersion, AttributeSource.AttributeFactory factory, TextReader in)
Parameters
Type | Name | Description |
---|---|---|
LuceneVersion | matchVersion | LuceneVersion to match |
AttributeSource.AttributeFactory | factory | the attribute factory to use for this Tokenizer |
System.IO.TextReader | in | the input to split up into tokens |