TokenType
- class TokenType
The possible types of token returned from each
get_next_token()
call.
Fields
- class TokenType
- BINARY
A binary integer
- CHAR
A character
- COMMA
A ‘,’ character
- COMMENT_MULTI
Multi line comment
- COMMENT_SINGLE
One line comment
- EOF
The end of the file
- EQUAL_SIGN
A ‘=’ character
- ERROR
An error occurred
- FLOAT
A floating point number
- HEX
A hex integer
- IDENTIFIER
An identifier
- IDENTIFIER_NULL
A null identifier
- INT
An integer
- LEFT_BRACE
A ‘[’ character
- LEFT_CURLY
A ‘{’ character
- LEFT_PAREN
A ‘(’ character
- NONE
Not a token
- OCTAL
An octal integer
- RIGHT_BRACE
A ‘]’ character
- RIGHT_CURLY
A ‘}’ character
- RIGHT_PAREN
A ‘)’ character
- STRING
A string
- SYMBOL
A symbol