mattzheng / py-kenlm-model
python | 高效使用统计语言模型kenlm:新词发现、分词、智能纠错等
☆163Updated 5 years ago
Related projects ⓘ
Alternatives and complementary repositories for py-kenlm-model
- SpellGCN☆243Updated 3 years ago
- Source code for the paper "PLOME: Pre-training with Misspelled Knowledge for Chinese Spelling Correction" in ACL2021☆230Updated 2 years ago
- 基于bert进行中文文本纠错☆226Updated last year
- Code for chinese error detection module, using n-gram and bi-lstm☆131Updated 5 years ago
- pytorch中文语言模型预训练☆389Updated 4 years ago
- 汉字字符特征提取工具,可以提取出字符中的字音(声母、韵母、声调)、字形(偏旁、部首)、四角编码等特征,同时可作为tensor输入到模型☆128Updated 4 years ago
- This repository is for the paper "A Hybrid Approach to Automatic Corpus Generation for Chinese Spelling Check"☆290Updated 5 years ago
- ☆100Updated 4 years ago
- Python toolkit for Chinese Language Understanding(CLUE) Evaluation benchmark☆128Updated last year
- chinese and english corpus process script, python, c++, java☆194Updated 5 years ago
- 中文NLP数据集☆151Updated 5 years ago
- ☆126Updated 2 years ago
- Modify Chinese text, modified on LaserTagger Model. 文本复述,基于lasertagger做中文文本数据增强。☆317Updated 10 months ago
- 中文谐音词/字库(同音词/字)Chinese Homophones☆95Updated 5 years ago
- Chinese NLP Data Augmentation, BERT Contextual Augmentation☆111Updated 2 years ago
- 🙈 An unofficial implementation of SoftMaskedBert based on huggingface/transformers.☆93Updated 3 years ago
- 整理一下在keras中使用T5模型的要点☆171Updated 2 years ago
- Bert finetune for CMRC2018, CJRC, DRCD, CHID, C3☆183Updated 4 years ago
- ☆258Updated 3 months ago
- 基于mlm方式的带有纠错功能的拼音转汉字bert预训练模型,pinyin correcter,基于pytorch框架实现☆45Updated 4 years ago
- 速度更快、效果更好的中文新词发现☆510Updated 8 months ago
- 中文预训练XLNet模型: Pre-Trained Chinese XLNet_Large☆230Updated 5 years ago
- Chinese Language Generation Evaluation 中文生成任务基准测评☆246Updated 3 years ago
- SIGHAN中文纠错数据集及转换后格式☆63Updated 4 years ago
- Unilm for Chinese Chitchat Robot.基于Unilm模型的夸夸式闲聊机器人项目。☆157Updated 3 years ago
- ☆92Updated 4 years ago
- 中国中文信息学会社会媒体处理专业委员会举办的2019届中文人机对话之自然语言理解竞赛☆74Updated 4 years ago
- Sequence labeling base on universal transformer (Transformer encoder) and CRF; 基于Universal Transformer + CRF 的中文分词和词性标注☆154Updated 5 years ago
- PyTorch impelementations of BERT-based Spelling Error Correction Models. 基于BERT的文本纠错模型,使用PyTorch实现。☆266Updated 10 months ago
- lasertagger-chinese;lasertagger中文学习案例,案例数据,注释,shell运行☆75Updated last year