Method UpdateSuffixToken
UpdateSuffixToken(Token, Token)
The default implementation adds last prefix token end offset to the suffix token start and end offsets.
Declaration
public virtual Token UpdateSuffixToken(Token suffixToken, Token lastPrefixToken)Parameters
| Type | Name | Description |
|---|---|---|
| Token | suffixToken | a token from the suffix stream |
| Token | lastPrefixToken | the last token from the prefix stream |
Returns
| Type | Description |
|---|---|
| Token | consumer token |
