alisawuffles / tokenizer-attack

Official implementation of "Data Mixture Inference: What do BPE tokenizers reveal about their training data?"
12Updated 8 months ago

Alternatives and similar repositories for tokenizer-attack

Users that are interested in tokenizer-attack are comparing it to the libraries listed below

Sorting: