OpenLMLab / ParallelTokenizer

Use the tokenizer in parallel to achieve superior acceleration
15Updated 5 months ago

Related projects: