Tokenizer Class |
[Missing <summary> documentation for "T:Demo3D.Core.Factory.Expression.Tokenizer"]
public class Tokenizer
The Tokenizer type exposes the following members.
| Name | Description | |
|---|---|---|
| Identifier | The identifier string. | |
| Number | The numeric value. | |
| Token | The current token. |
| Name | Description | |
|---|---|---|
| NextCharacter | Reads the next character from the input stream and stores it as the current character. | |
| NextToken | Reads the next token from the input stream and stores it as the current token. |