Class WhitespaceTokenizer
A WhitespaceTokenizer is a tokenizer that divides text at whitespace. Adjacent sequences of non-Whitespace characters form tokens.
Inheritance
System.Object
Lucene.Net.Util.AttributeSource
WhitespaceTokenizer
Inherited Members
Namespace:
Assembly: Lucene.Net.NetCore.dll
Syntax
public class WhitespaceTokenizer : CharTokenizer, IDisposableConstructors
| Name | Description |
|---|---|
|
Whitespace |
Construct a new WhitespaceTokenizer using a given Lucene. |
|
Whitespace |
Construct a new WhitespaceTokenizer using a given Lucene. |
|
Whitespace |
Construct a new WhitespaceTokenizer. |
Methods
| Name | Description |
|---|---|
|
Is |
Collects only characters which do not satisfy
|