Class Tokenizer

Parallels Spring Tokenizer

SpEL lexer: decomposes expression string into Token sequence. O(1) character type queries via character classification table.

Index

Constructors

Methods

nextToken tokenize

Constructors

constructor

new Tokenizer(expression: string): Tokenizer
Parameters
- expression: string
Returns Tokenizer
- Defined in tokenizer/tokenizer.ts:18

Methods

nextToken

nextToken(): Token
Main lexical analysis loop — returns next Token

Returns Token
- Defined in tokenizer/tokenizer.ts:26

tokenize

tokenize(): Token[]
Get all tokens (for debugging and testing)

Returns Token[]
- Defined in tokenizer/tokenizer.ts:484