Class RussianLetterTokenizer
A RussianLetterTokenizer is a Tokenizer that extends LetterTokenizer by also allowing the basic Latin digits 0-9.
You must specify the required LuceneVersion compatibility when creating RussianLetterTokenizer:
- As of 3.1, CharTokenizer uses an int based API to normalize and detect token characters. See IsTokenChar(Int32) and Normalize(Int32) for details.
Inheritance
System.Object
RussianLetterTokenizer
Inherited Members
Lucene.Net.Analysis.Tokenizer.SetReader(System.IO.TextReader)
System.Object.Equals(System.Object, System.Object)
System.Object.ReferenceEquals(System.Object, System.Object)
System.Object.GetType()
System.Object.MemberwiseClone()
Assembly: Lucene.Net.Analysis.Common.dll
Syntax
[Obsolete("(3.1) Use StandardTokenizer instead, which has the same functionality.")]
[Serializable]
public class RussianLetterTokenizer : CharTokenizer, IDisposableConstructors
| Name | Description |
|---|---|
| RussianLetterTokenizer(LuceneVersion, AttributeSource.AttributeFactory, TextReader) | Construct a new RussianLetterTokenizer using a given AttributeSource.AttributeFactory. |
| RussianLetterTokenizer(LuceneVersion, TextReader) | Construct a new RussianLetterTokenizer. |
Methods
| Name | Description |
|---|---|
| IsTokenChar(Int32) | Collects only characters which satisfy IsLetter(Int32). |
