Constructor LimitTokenCountAnalyzer
LimitTokenCountAnalyzer(Analyzer, Int32)
Build an analyzer that limits the maximum number of tokens per field. This analyzer will not consume any tokens beyond the maxTokenCount limit
Declaration
public LimitTokenCountAnalyzer(Analyzer delegate, int maxTokenCount)Parameters
| Type | Name | Description |
|---|---|---|
| Analyzer | delegate | |
| System.Int32 | maxTokenCount |
See Also
LimitTokenCountAnalyzer(Analyzer, Int32, Boolean)
Build an analyzer that limits the maximum number of tokens per field.
Declaration
public LimitTokenCountAnalyzer(Analyzer delegate, int maxTokenCount, bool consumeAllTokens)Parameters
| Type | Name | Description |
|---|---|---|
| Analyzer | delegate | the analyzer to wrap |
| System.Int32 | maxTokenCount | max number of tokens to produce |
| System.Boolean | consumeAllTokens | whether all tokens from the delegate should be consumed even if maxTokenCount is reached. |
