tryAGI / Tiktoken

This project implements token calculation for OpenAI's gpt-4 and gpt-3.5-turbo model, specifically using `cl100k_base` encoding.
57Updated this week

Related projects

Alternatives and complementary repositories for Tiktoken