xujiajun / gotokenizer

A tokenizer based on the dictionary and Bigram language models for Go. (Now only support chinese segmentation)
21Updated 5 years ago

Alternatives and similar repositories for gotokenizer:

Users that are interested in gotokenizer are comparing it to the libraries listed below