Class Token

Parallels Spring Token

Token produced by lexical analysis with position, kind, and optional text/payload.

Index

Constructors

Properties

endPos kind literal? payload? startPos

Accessors

Methods

isKeyword isLiteral isOperator

Constructors

constructor

new Token(
    kind: TokenKind,
    startPos: number,
    endPos: number,
    literal?: string,
    payload?: unknown,
): Token
Parameters
- kind: TokenKind
- startPos: number
- endPos: number
- Optionalliteral: string
- Optionalpayload: unknown
Returns Token
- Defined in tokenizer/token.ts:15

Properties

`Readonly`endPos

endPos: number

`Readonly`kind

kind: TokenKind

`Optional` `Readonly`literal

literal?: string

`Optional` `Readonly`payload

payload?: unknown

`Readonly`startPos

startPos: number

Accessors

length

get length(): number
Returns number
- Defined in tokenizer/token.ts:29

Methods

isKeyword

isKeyword(): boolean
Returns boolean
- Defined in tokenizer/token.ts:41

isLiteral

isLiteral(): boolean
Returns boolean
- Defined in tokenizer/token.ts:37

isOperator

isOperator(): boolean
Returns boolean
- Defined in tokenizer/token.ts:33