Class SentenceTokenizer
Tokenizes input text into sentences.
The output tokens can then be broken into words with WordTokenFilter
@lucene.experimentalInherited Members
Lucene.Net.Analysis.Tokenizer.SetReader(System.IO.TextReader)
Assembly: Lucene.Net.Analysis.SmartCn.dll
Syntax
public sealed class SentenceTokenizer : Tokenizer, IDisposableConstructors
| Name | Description |
|---|---|
| SentenceTokenizer(AttributeSource.AttributeFactory, TextReader) | |
| SentenceTokenizer(TextReader) |
Methods
| Name | Description |
|---|---|
| End() | |
| IncrementToken() | |
| Reset() |
