Class SegTokenFilter

Filters a SegToken by converting full-width latin to half-width, then lowercasing latin. Additionally, all punctuation is converted into COMMON_DELIMITER

@lucene.experimental

Inheritance
System.Object
SegTokenFilter
Assembly: Lucene.Net.Analysis.SmartCn.dll
Syntax
public class SegTokenFilter : object

Methods

Name Description
Filter(SegToken)

Filter an input SegToken

Full-width latin will be converted to half-width, then all latin will be lowercased. All punctuation is converted into COMMON_DELIMITER

Extension Methods