josephrocca / gpt-2-3-tokenizer

GPT-2/3 tokenizer based on @latitudegames/GPT-3-Encoder that works in the browser and Deno
32Updated last year

Related projects

Alternatives and complementary repositories for gpt-2-3-tokenizer