charlesXu86 / char_featurizer
汉字字符特征提取工具,可以提取出字符中的字音(声母、韵母、声调)、字形(偏旁、部首)、四角编码等特征,同时可作为tensor输入到模型
☆137Updated 4 years ago
Alternatives and similar repositories for char_featurizer:
Users that are interested in char_featurizer are comparing it to the libraries listed below
- Code for chinese error detection module, using n-gram and bi-lstm☆134Updated 6 years ago
- 基于bert进行中文文本纠错☆235Updated last year
- NLP NER datasets video/music/book bio☆88Updated 4 years ago
- WordForm,针对中文词语的笔画拆解,偏旁查询,拼音转换接口☆65Updated 6 years ago
- self complemented SpellCorrection based pinyin similairity, edit distance ,基于拼音相似度与编辑距离的查询纠错。☆82Updated 2 years ago
- 李傲龍的博客☆81Updated 9 months ago
- Word similarity computation based on Tongyici Cilin☆119Updated 7 years ago
- 基于轻量级的albert实现albert+BiLstm+CRF☆89Updated last year
- ChineseTextualInference project including chinese corpus build and inferecence model, 中文文本推断项目,包括88万文本蕴含中文 文本蕴含数据集的翻译与构建,基于深度学习的文本蕴含判定模型构建…☆172Updated 6 years ago
- python | 高效使用统计语言模型kenlm:新词发现、分词、智能纠错等☆164Updated 5 years ago
- SpellGCN☆252Updated 4 years ago
- CCKS2019评测任务五-公众公司公告信息抽取,第3名☆121Updated 5 years ago
- 汉字字符特征提取器 (featurizer),提取汉字的特征(发音特征、字形特征)用做深度学习的特征 | A Chinese character feature extractor, which extracts the features of Chinese charac…☆295Updated 4 years ago
- 中文版unilm预训练模型☆83Updated 4 years ago
- SmoothNLP领域词汇示例 - 基于复旦公开新闻资讯库☆49Updated 5 years ago
- 中文文本纠错模型,keras实现☆74Updated 3 years ago
- Bert finetune for CMRC2018, CJRC, DRCD, CHID, C3☆183Updated 4 years ago
- 教育行业新闻 自动文摘 语料库 自动摘要☆199Updated 6 years ago
- WordMultiSenseDisambiguation, chinese multi-wordsense disambiguation based on online bake knowledge base and semantic embedding similarit…☆127Updated 6 years ago
- 中文纠错☆92Updated 3 years ago
- Python toolkit for Chinese Language Understanding(CLUE) Evaluation benchmark☆129Updated last year
- NER(命名实体识别)中文语料,一站式获取☆128Updated 5 years ago
- Self complemented Pinyin2Chinese demo use algorithms including Trie and HMM model , 基于隐马尔科夫模型与Trie树的拼音切分与拼音转中文的简单demo实现。☆86Updated 7 years ago
- 基于BERT的无监督分词和句法分析☆110Updated 4 years ago
- 微调预训练语言模型(BERT、Roberta、XLBert等),用于计算两个文本之间的相似度(通过句子对分类任务转换),适用于中文文本☆89Updated 4 years ago
- 基于 TensorFlow & PaddlePaddle 的通用序列标注算法库(目前包含 BiLSTM+CRF, Stacked-BiLSTM+CRF 和 IDCNN+CRF,更多算法正在持续添加中)实现中文分词(Tokenizer / segmentation)、词性标注…☆84Updated 2 years ago
- Unilm for Chinese Chitchat Robot.基于Unilm模型的夸夸式闲聊机器人项目。☆157Updated 4 years ago
- Modify Chinese text, modified on LaserTagger Model. I name it "文本手术刀".目前,本项目实现了一个文本复述任务,用于NLP语料的数据增强。☆213Updated 2 years ago
- ☆102Updated 4 years ago
- 中文谐音词/字库(同音词/字)Chinese Homophones☆103Updated 5 years ago