charlesXu86 / char_featurizer
汉字字符特征提取工具，可以提取出字符中的字音（声母、韵母、声调）、字形（偏旁、部首）、四角编码等特征，同时可作为tensor输入到模型
☆128Updated 4 years ago
Related projects ⓘ
Alternatives and complementary repositories for char_featurizer
- Code for chinese error detection module, using n-gram and bi-lstm☆131Updated 5 years ago
- 基于bert进行中文文本纠错☆225Updated last year
- 李傲龍的博客☆81Updated 3 months ago
- 中文版unilm预训练模型☆82Updated 3 years ago
- 基于BERT的无监督分词和句法分析☆110Updated 4 years ago
- Python toolkit for Chinese Language Understanding(CLUE) Evaluation benchmark☆128Updated last year
- Self complemented Pinyin2Chinese demo use algorithms including Trie and HMM model , 基于隐马尔科夫模型与Trie树的拼音切分与拼音转中文的简单demo实现。☆84Updated 6 years ago
- NLP NER datasets video/music/book bio☆83Updated 3 years ago
- 基于检索的任务型多轮对话☆78Updated 4 years ago
- WordForm,针对中文词语的笔画拆解，偏旁查询，拼音转换接口☆63Updated 6 years ago
- 汉字字符特征提取器 (featurizer)，提取汉字的特征（发音特征、字形特征）用做深度学习的特征 ｜ A Chinese character feature extractor, which extracts the features of Chinese charac…☆284Updated 3 years ago
- python | 高效使用统计语言模型kenlm：新词发现、分词、智能纠错等☆162Updated 5 years ago
- 基于轻量级的albert实现albert+BiLstm+CRF☆88Updated last year
- 基于mlm方式的带有纠错功能的拼音转汉字bert预训练模型，pinyin correcter，基于pytorch框架实现☆44Updated 3 years ago
- CCKS2019评测任务五-公众公司公告信息抽取，第3名☆123Updated 5 years ago
- 微调预训练语言模型(BERT、Roberta、XLBert等),用于计算两个文本之间的相似度（通过句子对分类任务转换）,适用于中文文本☆90Updated 4 years ago
- SpellGCN☆242Updated 3 years ago
- NER（命名实体识别）中文语料，一站式获取☆126Updated 5 years ago
- 中文单词自动纠错☆121Updated 3 years ago
- Word similarity computation based on Tongyici Cilin☆117Updated 7 years ago
- DistilBERT for Chinese 海量中文预训练蒸馏bert模型☆90Updated 4 years ago
- Source code for the paper "PLOME: Pre-training with Misspelled Knowledge for Chinese Spelling Correction" in ACL2021☆229Updated 2 years ago
- ☆100Updated 4 years ago
- self complemented SpellCorrection based pinyin similairity, edit distance ，基于拼音相似度与编辑距离的查询纠错。☆79Updated 2 years ago
- transformers implement (architecture, task example, serving and more)☆97Updated 2 years ago
- 利用预训练的中文模型实现基于bert的语义匹配模型 数据集为LCQMC官方数据☆193Updated 4 years ago
- 中文文本纠错模型，keras实现☆70Updated 3 years ago
- 中国中文信息学会社会媒体处理专业委员会举办的2019届中文人机对话之自然语言理解竞赛☆74Updated 4 years ago
- 中文预训练XLNet模型: Pre-Trained Chinese XLNet_Large☆230Updated 5 years ago
- 中文谐音词/字库（同音词/字）Chinese Homophones☆95Updated 4 years ago