Constructor StandardTokenizer

StandardTokenizer(LuceneVersion, TextReader)

Creates a new instance of the StandardTokenizer. Attaches the input to the newly created JFlex-generated (then ported to .NET) scanner.

Declaration
public StandardTokenizer(LuceneVersion matchVersion, TextReader input)
Parameters
Type Name Description
LuceneVersion matchVersion

Lucene compatibility version - See StandardTokenizer

System.IO.TextReader input

The input reader

See http://issues.apache.org/jira/browse/LUCENE-1068

StandardTokenizer(LuceneVersion, AttributeSource.AttributeFactory, TextReader)

Creates a new StandardTokenizer with a given AttributeSource.AttributeFactory

Declaration
public StandardTokenizer(LuceneVersion matchVersion, AttributeSource.AttributeFactory factory, TextReader input)
Parameters
Type Name Description
LuceneVersion matchVersion
AttributeSource.AttributeFactory factory
System.IO.TextReader input