Constructor CJKTokenizer
CJKTokenizer(TextReader)
Construct a token stream processing the given input.
Declaration
public CJKTokenizer(TextReader in)Parameters
| Type | Name | Description |
|---|---|---|
| System.IO.TextReader | in | I/O reader |
CJKTokenizer(AttributeSource.AttributeFactory, TextReader)
Declaration
public CJKTokenizer(AttributeSource.AttributeFactory factory, TextReader in)Parameters
| Type | Name | Description |
|---|---|---|
| AttributeSource.AttributeFactory | factory | |
| System.IO.TextReader | in |
