Method Create
Create(TextReader)
Creates a TokenStream of the specified input using the default attribute factory.
Declaration
public Tokenizer Create(TextReader input)
Parameters
Type | Name | Description |
---|---|---|
System.IO.TextReader | input |
Returns
Type | Description |
---|---|
Tokenizer |
Create(AttributeSource.AttributeFactory, TextReader)
Creates a TokenStream of the specified input using the given AttributeSource.AttributeFactory
Declaration
public abstract Tokenizer Create(AttributeSource.AttributeFactory factory, TextReader input)
Parameters
Type | Name | Description |
---|---|---|
AttributeSource.AttributeFactory | factory | |
System.IO.TextReader | input |
Returns
Type | Description |
---|---|
Tokenizer |