Constructor Tokenizer
Tokenizer()
Construct a tokenizer with null input.
Declaration
protected Tokenizer()
Tokenizer(IO.TextReader)
Construct a token stream processing the given input.
Declaration
protected Tokenizer(IO.TextReader input)
Parameters
Type | Name | Description |
---|---|---|
System.IO.TextReader | input |
Tokenizer(AttributeSource.AttributeFactory)
Construct a tokenizer with null input using the given AttributeFactory.
Declaration
protected Tokenizer(AttributeSource.AttributeFactory factory)
Parameters
Type | Name | Description |
---|---|---|
Lucene.Net.Util.AttributeSource.AttributeFactory | factory |
Tokenizer(AttributeSource.AttributeFactory, IO.TextReader)
Construct a token stream processing the given input using the given AttributeFactory.
Declaration
protected Tokenizer(AttributeSource.AttributeFactory factory, IO.TextReader input)
Parameters
Type | Name | Description |
---|---|---|
Lucene.Net.Util.AttributeSource.AttributeFactory | factory | |
System.IO.TextReader | input |
Tokenizer(AttributeSource)
Construct a token stream processing the given input using the given AttributeSource.
Declaration
protected Tokenizer(AttributeSource source)
Parameters
Type | Name | Description |
---|---|---|
Lucene.Net.Util.AttributeSource | source |
Tokenizer(AttributeSource, IO.TextReader)
Construct a token stream processing the given input using the given AttributeSource.
Declaration
protected Tokenizer(AttributeSource source, IO.TextReader input)
Parameters
Type | Name | Description |
---|---|---|
Lucene.Net.Util.AttributeSource | source | |
System.IO.TextReader | input |