openai / tiktokenLinks

tiktoken is a fast BPE tokeniser for use with OpenAI's models.
β˜†15,911Updated 2 weeks ago

Alternatives and similar repositories for tiktoken

Users that are interested in tiktoken are comparing it to the libraries listed below

Sorting: