yuikns / icwb2-data
This directory contains the training, test, and gold-standard data used in the 2nd International Chinese Word Segmentation Bakeoff. Also included is the script used to score the results submitted by the bakeoff participants and the simple segmenter used to generate the baseline and topline data.
☆66Updated 6 years ago
Alternatives and similar repositories for icwb2-data:
Users that are interested in icwb2-data are comparing it to the libraries listed below
- 新词发现 基于词频、凝聚系数和左右邻接信息熵☆123Updated 5 years ago
- python CRF++实现分词☆37Updated 6 years ago
- 基于BERT的无监督分词和句法分析☆110Updated 4 years ago
- 基于 TensorFlow & PaddlePaddle 的通用序列标注算法库(目前包含 BiLSTM+CRF, Stacked-BiLSTM+CRF 和 IDCNN+CRF,更多算法正在持续添加中)实现中文分词(Tokenizer / segmentation)、词性标注…☆84Updated 2 years ago
- 使用BERT模型进行文本分类,相似句子判断,以及词性标注☆89Updated 6 years ago
- 新词发现算法(NewWordDetection)☆62Updated 7 years ago
- NER(命名实体识别)中文语料,一站式获取☆128Updated 5 years ago
- ChineseTextualInference project including chinese corpus build and inferecence model, 中文文本推断项目,包括88万文本蕴含中文文本蕴含数据集的翻译与构建,基于深度学习的文本蕴含判定模型构建…☆172Updated 6 years ago
- SMP2017中文人机对话评测数据☆107Updated 7 years ago
- Subword Encoding in Lattice LSTM for Chinese Word Segmentation☆53Updated 5 years ago
- self complemented SpellCorrection based pinyin similairity, edit distance ,基于拼音相似度与编辑距离的查询纠错。☆82Updated 2 years ago
- 人民日报1998年1-4月中文标注语料库☆30Updated 6 years ago
- DistilBERT for Chinese 海量中文预训练蒸馏bert模型☆91Updated 5 years ago
- A curated list of resources of chinese corpora for NLP(Natural Language Processing)☆74Updated 5 years ago
- Word similarity computation based on Tongyici Cilin☆119Updated 7 years ago
- 基于BERT的中文序列标注☆141Updated 6 years ago
- Tensorflow solution of NER task Using BiLSTM-CRF model with CMU/Google XLNet☆45Updated 5 years ago
- 中文语料 Bert finetune(Fine-tune Chinese for BERT)☆81Updated 6 years ago
- Code for chinese error detection module, using n-gram and bi-lstm☆135Updated 5 years ago
- CCKS 2019 Task 2: Entity Recognition and Linking☆94Updated 5 years ago
- 新词发现算法(NewWordDetection)☆92Updated 4 years ago
- 各大中文分词性能评测☆157Updated 6 years ago
- 依存关系分析,NLP,自然语言处理☆85Updated 3 years ago
- NLP NER datasets video/music/book bio☆88Updated 4 years ago
- 论文实现:《Chinese Grammatical Error Diagnosis with Long Short-Term Memory Networks》☆49Updated 6 years ago
- Relation Extraction 中文关系提取☆72Updated 6 years ago
- 基于最小熵原理的NLP工具包☆138Updated 3 years ago
- A Chinese word segment model based on BERT, F1-Score 97%☆92Updated 5 years ago
- WordMultiSenseDisambiguation, chinese multi-wordsense disambiguation based on online bake knowledge base and semantic embedding similarit…☆127Updated 6 years ago
- SmoothNLP领域词汇示例 - 基于复旦公开新闻资讯库☆49Updated 5 years ago