Constructor SegmentingTokenizerBase
SegmentingTokenizerBase(TextReader, BreakIterator)
Construct a new SegmenterBase, using the provided BreakIterator for sentence segmentation.
Note that you should never share BreakIterators across different TokenStreams, instead a newly created or cloned one should always be provided to this constructor.
Declaration
public SegmentingTokenizerBase(TextReader reader, BreakIterator iterator)Parameters
| Type | Name | Description |
|---|---|---|
| TextReader | reader | |
| BreakIterator | iterator |
SegmentingTokenizerBase(AttributeSource.AttributeFactory, TextReader, BreakIterator)
Construct a new SegmenterBase, also supplying the AttributeSource.AttributeFactory
Declaration
public SegmentingTokenizerBase(AttributeSource.AttributeFactory factory, TextReader reader, BreakIterator iterator)Parameters
| Type | Name | Description |
|---|---|---|
| AttributeSource.AttributeFactory | factory | |
| TextReader | reader | |
| BreakIterator | iterator |
