ezEngine  Milestone 7
ezTokenType Struct Reference

Describes which kind of token an ezToken is. More...

#include <Tokenizer.h>

Public Types

enum  Enum {
  Unknown, Whitespace, Identifier, NonIdentifier,
  Newline, LineComment, BlockComment, String1,
  String2, EndOfFile, ENUM_COUNT
}
 

Static Public Attributes

static const char * EnumNames [ENUM_COUNT]
 

Detailed Description

Describes which kind of token an ezToken is.

Member Enumeration Documentation

Enumerator
Unknown 

for internal use

Whitespace 

The token is a space or tab.

Identifier 

a series of alphanumerics or underscores

NonIdentifier 

Everything else.

Newline 

Either '
' or '
'.

LineComment 

A comment that starts with two slashes and ends at the next newline (or end of file)

BlockComment 

A comment that starts with a slash and a star, and ends at the next star/slash combination (or end of file)

String1 

A string enclosed in ".

String2 

A string enclosed in '.

EndOfFile 

End-of-file marker.

Member Data Documentation

const char * ezTokenType::EnumNames
static
Initial value:
=
{
"Unknown",
"Whitespace",
"Identifier",
"NonIdentifier",
"Newline",
"LineComment",
"BlockComment",
"String1",
"String2",
}

The documentation for this struct was generated from the following files: