charlesXu86 / char_featurizer
汉字字符特征提取工具,可以提取出字符中的字音(声母、韵母、声调)、字形(偏旁、部首)、四角编码等特征,同时可作为tensor输入到模型
☆128Updated 4 years ago
Related projects ⓘ
Alternatives and complementary repositories for char_featurizer
- Code for chinese error detection module, using n-gram and bi-lstm☆131Updated 5 years ago
- 基于bert进行中文文本纠错☆226Updated last year
- NLP NER datasets video/music/book bio☆83Updated 3 years ago
- 中文版unilm预训练模型☆82Updated 3 years ago
- 李傲龍的博客☆81Updated 4 months ago
- self complemented SpellCorrection based pinyin similairity, edit distance ,基于拼音相似度与编辑距离的查询纠错。☆79Updated 2 years ago
- python | 高效使用统计语言模型kenlm:新词发现、分词、智能纠错等☆163Updated 5 years ago
- 中文单词自动纠错☆120Updated 3 years ago
- WordForm,针对中文词语的笔画拆解,偏旁查询,拼音转换接口☆63Updated 6 years ago
- 基于BERT的无监督分词和句法分析☆110Updated 4 years ago
- ☆100Updated 4 years ago
- SpellGCN☆243Updated 3 years ago
- Self complemented Pinyin2Chinese demo use algorithms including Trie and HMM model , 基于隐马尔科夫模型与Trie树的拼音切分与拼音转中文的简单demo实现。☆84Updated 6 years ago
- Word similarity computation based on Tongyici Cilin☆117Updated 7 years ago
- 基于轻量级的albert实现albert+BiLstm+CRF☆88Updated last year
- Source code for the paper "PLOME: Pre-training with Misspelled Knowledge for Chinese Spelling Correction" in ACL2021☆230Updated 2 years ago
- 中文文本自动纠错☆80Updated 6 years ago
- Bert finetune for CMRC2018, CJRC, DRCD, CHID, C3☆183Updated 4 years ago
- Modify Chinese text, modified on LaserTagger Model. I name it "文本手术刀".目前,本项目实现了一个文本复述任务,用于NLP语料的数据增强。☆211Updated last year
- 中文谐音词/字库(同音词/字)Chinese Homophones☆95Updated 5 years ago
- 基于检索的任务型多轮对话☆78Updated 4 years ago
- 汉字字符特征提取器 (featurizer),提取汉字的特征(发音特征、字形特征)用做深度学习的特征 | A Chinese character feature extractor, which extracts the features of Chinese charac…☆284Updated 3 years ago
- transformers implement (architecture, task example, serving and more)☆97Updated 2 years ago
- 中文文本纠错模型,keras实现☆70Updated 3 years ago
- Python toolkit for Chinese Language Understanding(CLUE) Evaluation benchmark☆128Updated last year
- 中国中文信息学会社会媒体处理专业委员会举办的2019届中文人机对话之自然语言理解竞赛☆74Updated 4 years ago
- 中文生成式预训练模型☆98Updated 4 years ago
- 中文预训练XLNet模型: Pre-Trained Chinese XLNet_Large☆230Updated 5 years ago
- NER(命名实体识别)中文语料,一站式获取☆126Updated 5 years ago