howl-anderson / Chinese_tokenizer_benchmark
中文分词软件基准测试 | Chinese tokenizer benchmark
☆24Updated 6 years ago
Alternatives and similar repositories for Chinese_tokenizer_benchmark:
Users that are interested in Chinese_tokenizer_benchmark are comparing it to the libraries listed below
- This directory contains the training, test, and gold-standard data used in the 2nd International Chinese Word Segmentation Bakeoff. Also …☆66Updated 6 years ago
- ☆93Updated 5 months ago
- 依存关系分析,NLP,自然语言处理☆85Updated 3 years ago
- Subword Encoding in Lattice LSTM for Chinese Word Segmentation☆53Updated 6 years ago
- 基于最小熵原理的NLP工具包☆138Updated 3 years ago
- 新词发现算法(NewWordDetection)☆62Updated 7 years ago
- Quick run NLP in many task 快速运行分类、序列标注、匹配、生成等NLP任务的Tensorflow框架 (中文 NLP 支持分布式)☆30Updated 4 years ago
- 中文分词工具评估☆61Updated 2 years ago
- chinese anti semantic word search interface based on dict crawled from online resources, ChineseAntiword,针对中文词语的反义词查询接口☆59Updated 6 years ago
- 汉字字符特征提取工具,可以提取出字符中的字音(声母、韵母、声调)、字形(偏旁、部首)、四角编码等特征,同时可作为tensor输入到模型☆136Updated 4 years ago
- kenlm语言模型,并提供python的rest服务☆29Updated 6 years ago
- 中文环境突发事件语料库(Chinese Environment Emergency Corpus)-上海大学-语义智能实验室☆46Updated 9 years ago
- THU Chinese Keyphrase Extraction Toolkit☆125Updated 7 years ago
- Python toolkit for Chinese Language Understanding(CLUE) Evaluation benchmark☆129Updated last year
- A curated list of resources of chinese corpora for NLP(Natural Language Processing)☆75Updated 5 years ago
- WordForm,针对中文词语的笔画拆解,偏旁查询,拼音转换接口☆65Updated 6 years ago
- modification of official bert for downstream task☆31Updated 2 years ago
- 基于 TensorFlow & PaddlePaddle 的通用序列标注算法库(目前包含 BiLSTM+CRF, Stacked-BiLSTM+CRF 和 IDCNN+CRF,更多算法正在持续添加中)实现中文分词(Tokenizer / segmentation)、词性标注…☆84Updated 2 years ago
- 大规模中文语料☆41Updated 5 years ago
- 中文 NLP 语料库数据集☆20Updated 6 years ago
- ☆75Updated 2 years ago
- DistilBERT for Chinese 海量中文预训练蒸馏bert模型☆91Updated 5 years ago
- 新词发现算法(NewWordDetection)☆92Updated 4 years ago
- 新词发现 基于词频、凝聚系数和左右邻接信息熵☆122Updated 5 years ago
- A HMM-like linear-chain CRF, used Tensorflow API.☆36Updated 7 years ago
- Word similarity computation based on Tongyici Cilin☆119Updated 7 years ago
- 高性能小模型测评 Shared Tasks in NLPCC 2020. Task 1 - Light Pre-Training Chinese Language Model for NLP Task☆58Updated 4 years ago
- 中文生成式预训练模型☆98Updated 4 years ago
- The dataset and the evaluation tool for NLPCC2018 Shared Task2--Grammatical Error Correction (GEC).☆55Updated 3 years ago
- ☆89Updated 4 years ago