wisesight / newmm-tokenizer

Standalone Dictionary-based, Maximum Matching + Thai Character Cluster (newmm) tokenizer extracted from PyThaiNLP
13Updated 2 years ago

Related projects

Alternatives and complementary repositories for newmm-tokenizer