mattzheng / py-kenlm-model
python | 高效使用统计语言模型kenlm：新词发现、分词、智能纠错等
☆163Updated 5 years ago
Alternatives and similar repositories for py-kenlm-model:
Users that are interested in py-kenlm-model are comparing it to the libraries listed below
- SpellGCN☆251Updated 4 years ago
- 基于bert进行中文文本纠错☆232Updated last year
- This repository is for the paper "A Hybrid Approach to Automatic Corpus Generation for Chinese Spelling Check"☆293Updated 5 years ago
- 基于mlm方式的带有纠错功能的拼音转汉字bert预训练模型，pinyin correcter，基于pytorch框架实现☆45Updated 4 years ago
- Source code for the paper "PLOME: Pre-training with Misspelled Knowledge for Chinese Spelling Correction" in ACL2021☆234Updated 2 years ago
- SIGHAN中文纠错数据集及转换后格式☆62Updated 5 years ago
- chinese and english corpus process script, python, c++, java☆198Updated 6 years ago
- 🙈 An unofficial implementation of SoftMaskedBert based on huggingface/transformers.☆95Updated 3 years ago
- Bert finetune for CMRC2018, CJRC, DRCD, CHID, C3☆182Updated 4 years ago
- DistilBERT for Chinese 海量中文预训练蒸馏bert模型☆91Updated 5 years ago
- 中文谐音词/字库（同音词/字）Chinese Homophones☆100Updated 5 years ago
- Code for chinese error detection module, using n-gram and bi-lstm☆135Updated 5 years ago
- 李傲龍的博客☆81Updated 8 months ago
- ☆127Updated 2 years ago
- 中文版unilm预训练模型☆83Updated 4 years ago
- ☆125Updated 4 years ago
- Python toolkit for Chinese Language Understanding(CLUE) Evaluation benchmark☆129Updated last year
- 中文NLP数据集☆153Updated 5 years ago
- 整理一下在keras中使用T5模型的要点☆172Updated 3 years ago
- 汉字字符特征提取工具，可以提取出字符中的字音（声母、韵母、声调）、字形（偏旁、部首）、四角编码等特征，同时可作为tensor输入到模型☆134Updated 4 years ago
- Modify Chinese text, modified on LaserTagger Model. 文本复述，基于lasertagger做中文文本数据增强。☆318Updated last year
- 基于BERT的无监督分词和句法分析☆110Updated 4 years ago
- 对Faspell的复现和思考☆23Updated 2 years ago
- ☆102Updated 4 years ago
- ☆85Updated 3 years ago
- ☆74Updated 5 years ago
- ☆91Updated 4 years ago
- ☆265Updated 8 months ago
- 将百度ernie的paddlepaddle模型转成tensorflow模型☆177Updated 5 years ago
- 速度更快、效果更好的中文新词发现☆512Updated last year