Constructor PatternTokenizer
PatternTokenizer(TextReader, Regex, Int32)
creates a new PatternTokenizer returning tokens from group (-1 for split functionality)
Declaration
public PatternTokenizer(TextReader input, Regex pattern, int group)Parameters
| Type | Name | Description |
|---|---|---|
| System.IO.TextReader | input | |
| System.Text.RegularExpressions.Regex | pattern | |
| System.Int32 | group |
PatternTokenizer(AttributeSource.AttributeFactory, TextReader, Regex, Int32)
creates a new PatternTokenizer returning tokens from group (-1 for split functionality)
Declaration
public PatternTokenizer(AttributeSource.AttributeFactory factory, TextReader input, Regex pattern, int group)Parameters
| Type | Name | Description |
|---|---|---|
| AttributeSource.AttributeFactory | factory | |
| System.IO.TextReader | input | |
| System.Text.RegularExpressions.Regex | pattern | |
| System.Int32 | group |
