google / sentencepiece

Unsupervised text tokenizer for Neural Network-based text generation.
10,479Updated last month

Alternatives and similar repositories for sentencepiece:

Users that are interested in sentencepiece are comparing it to the libraries listed below