OpenLMLab / ParallelTokenizerLinks

Use the tokenizer in parallel to achieve superior acceleration
17Updated last year

Alternatives and similar repositories for ParallelTokenizer

Users that are interested in ParallelTokenizer are comparing it to the libraries listed below

Sorting: