karpathy / minbpeLinks

Minimal, clean code for the Byte Pair Encoding (BPE) algorithm commonly used in LLM tokenization.
9,662Updated 10 months ago

Alternatives and similar repositories for minbpe

Users that are interested in minbpe are comparing it to the libraries listed below

Sorting: