Method IsTokenChar
IsTokenChar(Int32)
Returns true iff a codepoint should be included in a token. This tokenizer generates as tokens adjacent sequences of codepoints which satisfy this predicate. Codepoints for which this is false are used to define token boundaries and are not included in tokens.
Declaration
protected abstract bool IsTokenChar(int c)Parameters
| Type | Name | Description |
|---|---|---|
| System.Int32 | c |
Returns
| Type | Description |
|---|---|
| System.Boolean |
