Skip to main content
Module

x/leac/leac.ts>createLexer

Lexer / tokenizer
Latest
function createLexer
import { createLexer } from "https://deno.land/x/leac@v0.6.0/leac.ts";

Create a lexer function.

Parameters

rules: Rules
  • Non-empty array of lexing rules.

Rules are processed in provided order, first match is taken.

Rules can have the same name - you can have separate rules for keywords and use the same name "keyword" for example.

optional
state: string
  • The name of this lexer. Use when composing lexers. Empty string by default.
optional
options: Options
  • Lexer options object.

Create a lexer function.

Parameters

rules: Rules
  • Non-empty array of lexing rules.

Rules are processed in provided order, first match is taken.

Rules can have the same name - you can have separate rules for keywords and use the same name "keyword" for example.

optional
options: Options
  • Lexer options object.