mattzheng / py-kenlm-modelLinks
python | 高效使用统计语言模型kenlm:新词发现、分词、智能纠错等
☆164Updated 5 years ago
Alternatives and similar repositories for py-kenlm-model
Users that are interested in py-kenlm-model are comparing it to the libraries listed below
Sorting:
- SpellGCN☆252Updated 4 years ago
- 基于bert进行中文文本纠错☆235Updated last year
- DistilBERT for Chinese 海量中文预训练蒸馏bert模型☆92Updated 5 years ago
- lasertagger-chinese;lasertagger中文学习案例,案例数据,注释,shell运行☆75Updated 2 years ago
- 中文NLP数据集☆153Updated 5 years ago
- Code for chinese error detection module, using n-gram and bi-lstm☆135Updated 6 years ago
- 中文谐音词/字库(同音词/字)Chinese Homophones☆105Updated 5 years ago
- This repository is for the paper "A Hybrid Approach to Automatic Corpus Generation for Chinese Spelling Check"☆294Updated 5 years ago
- 汉字字符特征提取工具,可以提取出字符中的字音(声母、韵母、声调)、字形(偏旁、部首)、四角编码等特征,同时可作为tensor输入到模型☆137Updated 5 years ago
- Source code for the paper "PLOME: Pre-training with Misspelled Knowledge for Chinese Spelling Correction" in ACL2021☆235Updated 2 years ago
- pytorch中文语言模型预训练☆389Updated 4 years ago
- chinese and english corpus process script, python, c++, java☆197Updated 6 years ago
- 🙈 An unofficial implementation of SoftMaskedBert based on huggingface/transformers.☆95Updated 4 years ago
- 整理一下在keras中使用T5模型的要点☆172Updated 3 years ago
- SIGHAN中文纠错数据集及转换后格式☆64Updated 5 years ago
- Chinese Language Generation Evaluation 中文生成任务基准测评☆247Updated 4 years ago
- 基于BERT的无监督分词和句法分析☆110Updated 4 years ago
- 使用bert做领域分类、意图识别和槽位填充任务☆76Updated 4 years ago
- ☆91Updated 5 years ago
- 微调预训练语言模型,解决多标签分类任务(可加载BERT、Roberta、Bert-wwm以及albert等知名开源tf格式的模型)☆141Updated 4 years ago
- ☆127Updated 2 years ago
- Bert finetune for CMRC2018, CJRC, DRCD, CHID, C3☆183Updated 5 years ago
- Python toolkit for Chinese Language Understanding(CLUE) Evaluation benchmark☆129Updated 2 years ago
- Modify Chinese text, modified on LaserTagger Model. 文本复述,基于lasertagger做中文文本数据增强。☆320Updated last year
- 各大中文分词性能评测☆157Updated 6 years ago
- 中文预训练XLNet模型: Pre-Trained Chinese XLNet_Large☆230Updated 5 years ago
- ChineseTextualInference project including chinese corpus build and inferecence model, 中文文本推断项目,包括88万文本蕴含中文文本蕴含数据集的翻译与构建,基于深度学习的文本蕴含判定模型构建…☆172Updated 6 years ago
- 中文版unilm预训练模型☆83Updated 4 years ago
- 基于mlm方式的带有纠错功能的拼音转汉字bert预训练模型,pinyin correcter,基于pytorch框架实现☆45Updated 4 years ago
- Modify Chinese text, modified on LaserTagger Model. I name it "文本手术刀".目前,本项目实现了一个文本复述任务,用于NLP语料的数据增强。☆214Updated 2 years ago