Skip to main content
Products
Open Source
Deno
Modern runtime for JavaScript and TypeScript
Fresh
Web framework designed for the edge
JSR
TypeScript-first ESM package registry
Cloud
Deploy
Easy serverless hosting for your JavaScript projects
Subhosting
Securely run untrusted code in a scalable sandbox
Pricing
Starts free and scales with your needs
Docs
Manual
API Reference
Deno Deploy
Deno KV
Deno by Example
Modules
Current path
deno.land/x
Standard Library
Node.js & npm
JSR
Blog
Search…
⌘K
Module
x
/
gpt_2_3_tokenizer
GPT-2/3 tokenizer based on @latitudegames/GPT-3-Encoder that works in the browser and Deno
josephrocca/gpt-2-3-tokenizer
Version
Latest
v0.0.2
v0.0.1
Directory
encoder.js
1018 KB
mod.js
4 KB
README.md
1020 B
vocab.bpe.js
467 KB