karpathy / minbpeLinks

Minimal, clean code for the Byte Pair Encoding (BPE) algorithm commonly used in LLM tokenization.
9,700Updated 11 months ago

Alternatives and similar repositories for minbpe

Users that are interested in minbpe are comparing it to the libraries listed below

Sorting: