xujiajun / gotokenizer

A tokenizer based on the dictionary and Bigram language models for Go. (Now only support chinese segmentation)
20Updated 5 years ago

Related projects: