howl-anderson / Chinese_tokenizer_benchmark
中文分词软件基准测试 | Chinese tokenizer benchmark
☆23Updated 6 years ago
Alternatives and similar repositories for Chinese_tokenizer_benchmark:
Users that are interested in Chinese_tokenizer_benchmark are comparing it to the libraries listed below
- This directory contains the training, test, and gold-standard data used in the 2nd International Chinese Word Segmentation Bakeoff. Also …☆66Updated 6 years ago
- ☆92Updated 2 months ago
- Subword Encoding in Lattice LSTM for Chinese Word Segmentation☆53Updated 5 years ago
- SMP2017中文人机对话评测数据☆107Updated 7 years ago
- 人民日报1998年1-4月中文标注语料库☆29Updated 6 years ago
- minitools☆104Updated 11 years ago
- 中文 NLP 语料库数据集☆20Updated 6 years ago
- Joint Embeddings of Chinese Words, Characters, and Fine-grained Subcharacter Components☆98Updated 5 years ago
- SemEval-2016 Task 9: Chinese Semantic Dependency Parsing☆135Updated 6 years ago
- 中文分词工具评估☆61Updated 2 years ago
- Python scripts preprocessing Penn Treebank and Chinese Treebank☆161Updated 4 years ago
- Python version of the evaluation script from CoNLL'00-☆91Updated 4 years ago
- 大规模中文语料☆40Updated 5 years ago
- DistilBERT for Chinese 海量中文预训练蒸馏bert模型☆90Updated 5 years ago
- 基于最小熵原理的NLP工具包☆138Updated 3 years ago
- The dataset and the evaluation tool for NLPCC2018 Shared Task2--Grammatical Error Correction (GEC).☆55Updated 2 years ago
- ☆75Updated last year
- 中文环境突发事件语料库（Chinese Environment Emergency Corpus）-上海大学-语义智能实验室☆43Updated 9 years ago
- 中文版unilm预训练模型☆83Updated 3 years ago
- 依存关系分析，NLP，自然语言处理☆85Updated 3 years ago
- Corpus creator for Chinese Wikipedia☆41Updated 3 years ago
- 中文生成式预训练模型☆98Updated 4 years ago
- 基于BERT的无监督分词和句法分析☆111Updated 4 years ago
- Python toolkit for Chinese Language Understanding(CLUE) Evaluation benchmark☆128Updated last year
- Self complemented Word Collocation using MI method which is tested to be effective..基于互信息算法的词语搭配抽取☆28Updated 6 years ago
- 新词发现算法(NewWordDetection)☆62Updated 7 years ago
- 新词发现 基于词频、凝聚系数和左右邻接信息熵☆124Updated 4 years ago
- Source codes for paper "Neural Networks Incorporating Dictionaries for Chinese Word Segmentation", AAAI 2018☆90Updated 6 years ago
- A tool for extracting chunks from Penn Chinese Treebank☆18Updated 7 years ago
- Baseline for the CNLI corpus☆56Updated 5 years ago