Constructor Tokenizer
Tokenizer()
Construct a tokenizer with null input.
Declaration
protected Tokenizer()Tokenizer(IO.TextReader)
Construct a token stream processing the given input.
Declaration
protected Tokenizer(IO.TextReader input)Parameters
| Type | Name | Description |
|---|---|---|
| System. |
input |
Tokenizer(AttributeSource.AttributeFactory)
Construct a tokenizer with null input using the given AttributeFactory.
Declaration
protected Tokenizer(AttributeSource.AttributeFactory factory)Parameters
| Type | Name | Description |
|---|---|---|
| Lucene. |
factory |
Tokenizer(AttributeSource.AttributeFactory, IO.TextReader)
Construct a token stream processing the given input using the given AttributeFactory.
Declaration
protected Tokenizer(AttributeSource.AttributeFactory factory, IO.TextReader input)Parameters
| Type | Name | Description |
|---|---|---|
| Lucene. |
factory | |
| System. |
input |
Tokenizer(AttributeSource)
Construct a token stream processing the given input using the given AttributeSource.
Declaration
protected Tokenizer(AttributeSource source)Parameters
| Type | Name | Description |
|---|---|---|
| Lucene. |
source |
Tokenizer(AttributeSource, IO.TextReader)
Construct a token stream processing the given input using the given AttributeSource.
Declaration
protected Tokenizer(AttributeSource source, IO.TextReader input)Parameters
| Type | Name | Description |
|---|---|---|
| Lucene. |
source | |
| System. |
input |