Skip to main content
Using Deno in production at your company? Earn free Deno merch.
Give us feedback
Module

x/netsaur/tokenizers/mod.ts>Tokenizer#tokenToId

Powerful machine learning, accelerated by WebGPU
denosaurs/netsaur
Latest
method Tokenizer.prototype.tokenToId
import { Tokenizer } from "https://deno.land/x/netsaur@0.3.2-patch/tokenizers/mod.ts";

Get the id from a token

Parameters

token: string

Returns

number