Skip to main content
Module

x/tokenizer/rule.ts

⚙️ A simple tokenizer for deno
eliassjogreen/deno_tokenizer
Latest
import * as tokenizer from "https://deno.land/x/tokenizer@0.1.0/rule.ts";

Interfaces

Represents a Rule to be scanned for in the Tokenizer