Class StreamTokenizer

Constructs a new StreamTokenizer with input as source input stream. This constructor is deprecated; instead, the constructor that takes a as an arugment should be used.

Constructs a new {@code StreamTokenizer} with {@code r} as source reader. The tokenizer's initial state is as follows:

• All byte values 'A' through 'Z', 'a' through 'z', and '\u00A0' through '\u00FF' are considered to be alphabetic.
• All byte values '\u0000' through '\u0020' are considered to be white space. '/' is a comment character.
• Single quote ''' and double quote '"' are string quote characters.
• Numbers are parsed.
• End of lines are considered to be white space rather than separate tokens.
• C-style and C++-style comments are not recognized.

The constant representing the end of the stream.

The constant representing the end of the line.

The constant representing a number token.

The constant representing a word token.

Specifies whether the end of a line is significant and should be returned as TT_EOF in TokenType by this tokenizer. true if EOL is significant, false otherwise.

Gets the current line number.

Specifies whether word tokens should be converted to lower case when they are stored in StringValue. true if StringValue should be converted to lower case, false otherwise.

Contains a number if the current token is a number (TokenType == TT_NUMBER).

Specifies whether "slash-slash" (C++-style) comments shall be recognized. This kind of comment ends at the end of the line. true if // should be recognized as the start of a comment, false otherwise.

Specifies whether "slash-star" (C-style) comments shall be recognized. Slash-star comments cannot be nested and end when a star-slash combination is found. true if /* should be recognized as the start of a comment, false otherwise.

Contains a string if the current token is a word (TokenType == TT_WORD).

After calling {@code nextToken()}, {@code ttype} contains the type of token that has been read. When a single character is read, its value converted to an integer is stored in {@code ttype}. For a quoted string, the value is the quoted character. Otherwise, its value is one of the following:

• TT_WORD - the token is a word.
• TT_NUMBER - the token is a number.
• TT_EOL - the end of line has been reached. Depends on whether IsEOLSignificant is true.
• TT_EOF - the end of the stream has been reached.

Specifies that the character ch shall be treated as a comment character.

Parses the next token from this tokenizer's source stream or reader. The type of the token is stored in the TokenType field, additional information may be stored in the NumberValue or StringValue fields.

Specifies that the character ch shall be treated as an ordinary character by this tokenizer. That is, it has no special meaning as a comment character, word component, white space, string delimiter or number.

Specifies that the characters in the range from low to hi shall be treated as an ordinary character by this tokenizer. That is, they have no special meaning as a comment character, word component, white space, string delimiter or number.

Specifies that this tokenizer shall parse numbers.

Indicates that the current token should be pushed back and returned again the next time NextToken() is called.

Specifies that the character ch shall be treated as a quote character.

Specifies that all characters shall be treated as ordinary characters.

Returns the state of this tokenizer in a readable format.

Specifies that the characters in the range from low to hi shall be treated as whitespace characters by this tokenizer.

Specifies that the characters in the range from low to hi shall be treated as word characters by this tokenizer. A word consists of a word character followed by zero or more word or number characters.