Skip to main content
Module

x/gpt_2_3_tokenizer/mod.js

GPT-2/3 tokenizer based on @latitudegames/GPT-3-Encoder that works in the browser and Deno
josephrocca/gpt-2-3-tokenizer
Go to Latest
import * as gpt23Tokenizer from "https://deno.land/x/gpt_2_3_tokenizer@v0.0.1/mod.js";