Enum JapaneseTokenizerType
Token type reflecting the original source of this token
Assembly: Lucene.Net.Analysis.Kuromoji.dll
Syntax
public enum JapaneseTokenizerType : intFields
| Name | Description |
|---|---|
| KNOWN | Known words from the system dictionary. |
| UNKNOWN | Unknown words (heuristically segmented). |
| USER | Known words from the user dictionary. |
