xujiajun / gotokenizerLinks
A tokenizer based on the dictionary and Bigram language models for Go. (Now only support chinese segmentation)
☆21Updated 6 years ago
Alternatives and similar repositories for gotokenizer
Users that are interested in gotokenizer are comparing it to the libraries listed below
Sorting:
- ⏳ Provide filtering, sanitizing, and conversion of Golang data. 提供对Golang数据的过滤,净化,转换。☆151Updated last month
- go routine control, abstraction of the Main and some useful Executors.如果你不会管理Goroutine的话,用它☆62Updated last year
- x/sync/singleflight but with Go 1.18 generics