yishuihanhan / wordninja
Probabilistically split concatenated words using NLP based on English Wikipedia unigram frequencies.
☆50Updated 6 years ago
Alternatives and similar repositories for wordninja:
Users that are interested in wordninja are comparing it to the libraries listed below
- chinese and english corpus process script, python, c++, java☆194Updated 6 years ago
- This repository is for the paper "A Hybrid Approach to Automatic Corpus Generation for Chinese Spelling Check"☆291Updated 5 years ago
- 将百度ernie的paddlepaddle模型转成tensorflow模型☆177Updated 5 years ago
- 基于mlm方式的带有纠错功能的拼音转汉字bert预训练模型,pinyin correcter,基于pytorch框架实现☆45Updated 4 years ago
- 基于BERT的无监督分词和句法分析☆111Updated 4 years ago
- lasertagger-chinese;lasertagger中文学习案例,案例数据,注释,shell运行☆75Updated last year
- ☆91Updated 4 years ago
- ☆127Updated 2 years ago
- python | 高效使用统计语言模型kenlm:新词发现、分词、智能纠错等☆162Updated 5 years ago
- Python toolkit for Chinese Language Understanding(CLUE) Evaluation benchmark☆128Updated last year
- A Multi-modal Model Chinese Spell Checker Released on ACL2021.☆155Updated last year
- Modify Chinese text, modified on LaserTagger Model. I name it "文本手术刀".目前,本项目实现了一个文本复述任务,用于NLP语料的数据增强。☆210Updated last year
- Bert finetune for CMRC2018, CJRC, DRCD, CHID, C3☆182Updated 4 years ago
- Pytorch Bert Finetune in Chinese Text Classification☆215Updated 10 months ago
- SpellGCN☆245Updated 3 years ago
- 整理一下在keras中使用T5模型的要点☆172Updated 2 years ago
- 中文 预训练 ELECTRA 模型: 基于对抗学习 pretrain Chinese Model☆139Updated 4 years ago
- This is the official code for paper titled "Exploration and Exploitation: Two Ways to Improve Chinese Spelling Correction Models".☆67Updated 3 years ago
- 中文版unilm预训练模型☆83Updated 4 years ago
- Collections of Chinese reading comprehension datasets☆215Updated 5 years ago
- 论文实现:《Chinese Grammatical Error Diagnosis with Long Short-Term Memory Networks》☆49Updated 5 years ago
- chinese version of longformer☆111Updated 4 years ago
- Chinese Language Generation Evaluation 中文生成任务基准测评☆246Updated 4 years ago
- 中文预训练XLNet模型: Pre-Trained Chinese XLNet_Large☆229Updated 5 years ago
- 一个简单易用的 Python 模块,用于通过字符串来操作日期/时间。正则时间提取,字符串时间解析,字符串时间提取。中文时间提取,一句话里面提取时间☆75Updated 7 months ago
- ☆51Updated 4 years ago
- A curated list of resources of chinese corpora for NLP(Natural Language Processing)☆74Updated 5 years ago
- 各大中文分词性能评测☆155Updated 6 years ago
- OCNLI: 中文原版自然语言推理任务☆150Updated 3 years ago
- Performance comparison between Chinese word segmentation and part-of-speech tagging tools☆58Updated 5 years ago