import * as tokenizer from "https://deno.land/x/tokenizer@0.1.0/mod.ts";
Interfaces
I Rule | Represents a Rule to be scanned for in the Tokenizer |
Represents the Token that will be return on a match when scanning in the Tokenizer |
import * as tokenizer from "https://deno.land/x/tokenizer@0.1.0/mod.ts";
I Rule | Represents a Rule to be scanned for in the Tokenizer |
Represents the Token that will be return on a match when scanning in the Tokenizer |