Alternatives and similar repositories for Chinese_tokenizer_benchmark

Users that are interested in Chinese_tokenizer_benchmark are comparing it to the libraries listed below

• yuikns / icwb2-data
  This directory contains the training, test, and gold-standard data used in the 2nd International Chinese Word Segmentation Bakeoff. Also …
  ☆68Updated 7 years ago
• chqiwang / convseg
  Convolutional neural network and word embeddings for Chinese word segmentation
  ☆147Updated 3 years ago
• UniversalDependencies / UD_Chinese-GSD
  ☆96Updated last month
• jiesutd / SubwordEncoding-CWS
  Subword Encoding in Lattice LSTM for Chinese Word Segmentation
  ☆54Updated 6 years ago
• bojone / chinese-gen
  中文生成式预训练模型
  ☆99Updated 5 years ago
• hankcs / multi-criteria-cws
  Simple Solution for Multi-Criteria Chinese Word Segmentation
  ☆303Updated 5 years ago
• thunlp / THUCKE
  THU Chinese Keyphrase Extraction Toolkit
  ☆124Updated 7 years ago
• dalinvip / cw2vec
  cw2vec: Learning Chinese Word Embeddings with Stroke n-gram Information
  ☆275Updated 2 years ago
• chatopera / text-dependency-parser
  依存关系分析，NLP，自然语言处理
  ☆85Updated 4 years ago
• HKUST-KnowComp / JWE
  Joint Embeddings of Chinese Words, Characters, and Fine-grained Subcharacter Components
  ☆100Updated 6 years ago
• ownthink / evaluation
  各大中文分词性能评测
  ☆157Updated 6 years ago
• HIT-SCIR / SemEval-2016
  SemEval-2016 Task 9: Chinese Semantic Dependency Parsing
  ☆138Updated 7 years ago
• LG-1 / video_music_book_datasets
  NLP NER datasets video/music/book bio
  ☆90Updated 4 years ago
• ymcui / Chinese-Cloze-RC
  A Chinese Cloze-style RC Dataset: People's Daily & Children's Fairy Tale (CFT)
  ☆173Updated 6 years ago
• chatopera / wikidata-corpus
  Train Wikidata with word2vec for word embedding tasks
  ☆123Updated 7 years ago
• thunlp / SE-WRL
  Improved Word Representation Learning with Sememes
  ☆198Updated 7 years ago
• shijiebei2009 / CEEC-Corpus
  中文环境突发事件语料库（Chinese Environment Emergency Corpus）-上海大学-语义智能实验室
  ☆46Updated 9 years ago
• GlassyWing / transformer-word-segmenter
  Sequence labeling base on universal transformer (Transformer encoder) and CRF; 基于Universal Transformer + CRF 的中文分词和词性标注
  ☆161Updated 6 years ago
• bojone / nlp-zero
  基于最小熵原理的NLP工具包
  ☆138Updated 3 years ago
• SVAIGBA / WMSeg
  ☆174Updated 2 years ago
• HITlilingzhi / SMP2017ECDT-DATA
  SMP2017中文人机对话评测数据
  ☆108Updated 8 years ago
• zhangyics / Chinese-abbreviation-dataset
  This is a corpus of Chinese abbreviation, including negative full forms.
  ☆197Updated 4 years ago
• CLUEbenchmark / DistilBert
  DistilBERT for Chinese 海量中文预训练蒸馏bert模型
  ☆95Updated 5 years ago
• liuhuanyong / CognitiveInference
  Cognitive Inference，认知推理、常识知识库、常识推理与常识推理评估的系统项目，以现有国内外已有的常识知识库为研究对象，从常识知识库资源建设和常识推理测试评估两个方面出发进行整理，并结合自己近几年来在逻辑性推理知识库的构建、应用以及理论思考进行介绍。具体包括…
  ☆123Updated 5 years ago
• pluto-junzeng / C4-zh
  大规模中文语料
  ☆44Updated 5 years ago
• Qznan / QizNLP
  Quick run NLP in many task 快速运行分类、序列标注、匹配、生成等NLP任务的Tensorflow框架 (中文 NLP 支持分布式）
  ☆31Updated 4 years ago
• MechanicPang / New-Word-Detection
  新词发现算法(NewWordDetection)
  ☆63Updated 8 years ago
• bojone / perturbed_masking
  基于BERT的无监督分词和句法分析
  ☆110Updated 5 years ago
• Mleader2 / text_scalpel
  Modify Chinese text, modified on LaserTagger Model. I name it "文本手术刀".目前，本项目实现了一个文本复述任务，用于NLP语料的数据增强。
  ☆214Updated 2 years ago
• CLUEbenchmark / CLUEWSC2020
  CLUEWSC2020: WSC Winograd模式挑战中文版，中文指代消解任务
  ☆78Updated 5 years ago