Struct Token
This only represents terminals. Nonterminals aren't constructed since the AST is directly built during parsing.
Fields
| Name |
Type |
Descrption |
|
symbol
|
Symbol |
The "type" of this token |
|
location
|
Location |
|
|
value
|
VariantN!(20,bool,string,dchar,int,long,float,double,real,Date,DateTimeFrac,SysTime,DateTimeFracUnknownZone,Duration,ubyte[],typeof(null)) |
Only valid when 'symbol' is symbol!"Value", otherwise null |
|
data
|
string |
Original text from source |
Methods
| Name |
Description |
|
opEquals
|
Tokens with differing symbols are always unequal. Tokens with differing values are always unequal. Tokens with differing Value types are always unequal. Member 'location' is always ignored for comparison. Member 'data' is ignored for comparison *EXCEPT* when the symbol is Ident. |
|
matches
|
|
|
opAssign
|
|