Class IndicTokenizer

Simple Tokenizer for text in Indian Languages.

Inheritance
System.Object
AttributeSource
TokenStream
Tokenizer
CharTokenizer
IndicTokenizer
Inherited Members
Lucene.Net.Analysis.Tokenizer.SetReader(System.IO.TextReader)
System.Object.Equals(System.Object, System.Object)
System.Object.ReferenceEquals(System.Object, System.Object)
System.Object.GetType()
System.Object.MemberwiseClone()
Assembly: Lucene.Net.Analysis.Common.dll
Syntax
[Obsolete("(3.6) Use StandardTokenizer instead.")]
[Serializable]
public sealed class IndicTokenizer : CharTokenizer, IDisposable

Constructors

Name Description
IndicTokenizer(LuceneVersion, AttributeSource.AttributeFactory, TextReader)
IndicTokenizer(LuceneVersion, TextReader)

Methods

Name Description
IsTokenChar(Int32)

Extension Methods