Skip to main content
Using Deno in production at your company? Earn free Deno merch.
Give us feedback
Module

x/netsaur/tokenizers/mod.ts>Tokenizer#getVocabSize

Powerful machine learning, accelerated by WebGPU
Latest
method Tokenizer.prototype.getVocabSize
import { Tokenizer } from "https://deno.land/x/netsaur@0.3.2-patch/tokenizers/mod.ts";

Get the vocab size

Parameters

optional
withAddedTokens = [UNSUPPORTED]

Returns

number