The struct scanner_token describes one scanner state. More...

#include <scanner.h>

Data Fields
int	type
	The type of the token.
int	precedence
	Some precedence value.
const char *	string
	The start of the token string and the token length.
int	length

Detailed Description

The struct scanner_token describes one scanner state.

There are two kinds of tokens: char and non-char tokens. Char tokens contains only one char and simply have their char value as type. They are tokens having special control meaning in the code, like ':', ';', '{', '}' and '*'. Non char tokens has one or more chars and contain stuff like number or indentifier strings.

Field Documentation

◆ length

int scanner_token::length

◆ precedence

int scanner_token::precedence

Some precedence value.

◆ string

const char* scanner_token::string

The start of the token string and the token length.

◆ type

int scanner_token::type

The type of the token.

The documentation for this struct was generated from the following file: