niieani / gpt-tokenizerLinks

The fastest JavaScript BPE Tokenizer Encoder Decoder for OpenAI's GPT models (gpt-5, gpt-o*, gpt-4o, etc.). Port of OpenAI's tiktoken with additional features.
644Updated 2 weeks ago

Alternatives and similar repositories for gpt-tokenizer

Users that are interested in gpt-tokenizer are comparing it to the libraries listed below

Sorting: