yuikns / icwb2-dataLinks
This directory contains the training, test, and gold-standard data used in the 2nd International Chinese Word Segmentation Bakeoff. Also included is the script used to score the results submitted by the bakeoff participants and the simple segmenter used to generate the baseline and topline data.
☆68Updated 7 years ago
Alternatives and similar repositories for icwb2-data
Users that are interested in icwb2-data are comparing it to the libraries listed below
Sorting:
- Sequence labeling base on universal transformer (Transformer encoder) and CRF; 基于Universal Transformer + CRF 的中文分词和词性标注☆159Updated 6 years ago
- 新词发现 基于词频、凝聚系数和左右邻接信息熵☆123Updated 5 years ago
- python CRF++实现分词☆37Updated 7 years ago
- Simple Solution for Multi-Criteria Chinese Word Segmentation☆303Updated 5 years ago
- Word similarity computation based on Tongyici Cilin☆121Updated 8 years ago
- 各大中文分词性能评测☆158Updated 6 years ago
- 依存关系分析,NLP,自然语言处理☆85Updated 3 years ago
- NER(命名实体识别)中文语料,一站式获取☆131Updated 6 years ago
- DistilBERT for Chinese 海量中文预训练蒸馏bert模型☆94Updated 5 years ago
- NLP NER datasets video/music/book bio☆90Updated 4 years ago
- 新词发现算法(NewWordDetection)☆93Updated 4 years ago
- 基于最小熵原理的NLP工具包☆138Updated 3 years ago
- ☆174Updated 2 years ago
- 使用BERT模型进行文本分类,相似句子判断,以及词性标注☆90Updated 6 years ago
- SMP2017中文人机对话评测数据☆108Updated 7 years ago
- 基于BERT的无监督分词和句法分析☆110Updated 5 years ago
- 基于 TensorFlow & PaddlePaddle 的通用序列标注算法库(目前包含 BiLSTM+CRF, Stacked-BiLSTM+CRF 和 IDCNN+CRF,更多算法正在持续添加中)实现中文分词(Tokenizer / segmentation)、词性标注…☆86Updated 2 years ago
- 基于ltp的简单评论观点抽取模块☆117Updated 6 years ago
- 教育行业新闻 自动文摘 语料库 自动摘要☆202Updated 7 years ago
- ChineseTextualInference project including chinese corpus build and inferecence model, 中文文本推断项目,包括88万文本蕴含中文文本蕴含数据集的翻译与构建,基于深度学习的文本蕴含判定模型构建…☆175Updated 6 years ago
- E-Commerce Sentiment Dict☆130Updated 7 years ago
- 将百度ernie的paddlepaddle模型转成tensorflow模型☆178Updated 5 years ago
- 新词发现算法(NewWordDetection)☆63Updated 8 years ago
- Code for chinese error detection module, using n-gram and bi-lstm☆135Updated 6 years ago
- 中文语料 Bert finetune(Fine-tune Chinese for BERT)☆82Updated 6 years ago
- chinese and english corpus process script, python, c++, java☆198Updated 6 years ago
- A Chinese word segment model based on BERT, F1-Score 97%☆95Updated 6 years ago
- 基于 Bi-LSTM 和 CRF 的中文语义角色标注☆88Updated 6 years ago
- Chinese "spelling" error correction☆264Updated 7 years ago
- transformers implement (architecture, task example, serving and more)☆96Updated 3 years ago