gautierdag / bpeasy

Fast bare-bones BPE for modern tokenizer training
154Updated last month

Alternatives and similar repositories for bpeasy:

Users that are interested in bpeasy are comparing it to the libraries listed below