Constructor TokenStreamComponents
TokenStreamComponents(Tokenizer, TokenStream)
Creates a new TokenStreamComponents instance.
Declaration
public TokenStreamComponents(Tokenizer source, TokenStream result)
Parameters
Type | Name | Description |
---|---|---|
Tokenizer | source | the analyzer's tokenizer |
TokenStream | result | the analyzer's resulting token stream |
TokenStreamComponents(Tokenizer)
Creates a new TokenStreamComponents instance.
Declaration
public TokenStreamComponents(Tokenizer source)
Parameters
Type | Name | Description |
---|---|---|
Tokenizer | source | the analyzer's tokenizer |