diasks2 / pragmatic_tokenizer

A multilingual tokenizer to split a string into tokens
91Updated 6 months ago

Alternatives and similar repositories for pragmatic_tokenizer:

Users that are interested in pragmatic_tokenizer are comparing it to the libraries listed below