Alternatives and similar repositories for Chinese_tokenizer_benchmark

Users that are interested in Chinese_tokenizer_benchmark are comparing it to the libraries listed below

• yuikns / icwb2-data
  This directory contains the training, test, and gold-standard data used in the 2nd International Chinese Word Segmentation Bakeoff. Also …
  ☆68Updated 7 years ago
• CLUEbenchmark / DistilBert
  DistilBERT for Chinese 海量中文预训练蒸馏bert模型
  ☆93Updated 5 years ago
• bojone / chinese-gen
  中文生成式预训练模型
  ☆99Updated 5 years ago
• UniversalDependencies / UD_Chinese-GSD
  ☆95Updated last month
• hankcs / multi-criteria-cws
  Simple Solution for Multi-Criteria Chinese Word Segmentation
  ☆303Updated 5 years ago
• chatopera / text-dependency-parser
  依存关系分析，NLP，自然语言处理
  ☆85Updated 3 years ago
• thunlp / THUCKE
  THU Chinese Keyphrase Extraction Toolkit
  ☆124Updated 7 years ago
• dalinvip / cw2vec
  cw2vec: Learning Chinese Word Embeddings with Stroke n-gram Information
  ☆275Updated 2 years ago
• bojone / perturbed_masking
  基于BERT的无监督分词和句法分析
  ☆110Updated 5 years ago
• HITlilingzhi / SMP2017ECDT-DATA
  SMP2017中文人机对话评测数据
  ☆108Updated 7 years ago
• CodeBankofAnan / New-Word-Detection
  新词发现算法(NewWordDetection)
  ☆63Updated 7 years ago
• SVAIGBA / WMSeg
  ☆174Updated 2 years ago
• yanghanxy / New-Word-Detection
  新词发现算法(NewWordDetection)
  ☆93Updated 4 years ago
• bojone / nlp-zero
  基于最小熵原理的NLP工具包
  ☆138Updated 3 years ago
• GlassyWing / transformer-word-segmenter
  Sequence labeling base on universal transformer (Transformer encoder) and CRF; 基于Universal Transformer + CRF 的中文分词和词性标注
  ☆159Updated 6 years ago
• SVAIGBA / TwASP
  ☆75Updated 2 years ago
• LG-1 / video_music_book_datasets
  NLP NER datasets video/music/book bio
  ☆90Updated 4 years ago
• luozhouyang / AutoPhraseX
  Automated Phrase Mining from Massive Text Corpora in Python.
  ☆172Updated 4 years ago
• ownthink / evaluation
  各大中文分词性能评测
  ☆158Updated 6 years ago
• Rayarrow / New-Word-Discovery
  新词发现 基于词频、凝聚系数和左右邻接信息熵
  ☆123Updated 5 years ago
• HIT-SCIR / SemEval-2016
  SemEval-2016 Task 9: Chinese Semantic Dependency Parsing
  ☆137Updated 7 years ago
• ashengtx / CilinSimilarity
  Word similarity computation based on Tongyici Cilin
  ☆121Updated 8 years ago
• charlesXu86 / char_featurizer
  汉字字符特征提取工具，可以提取出字符中的字音（声母、韵母、声调）、字形（偏旁、部首）、四角编码等特征，同时可作为tensor输入到模型
  ☆137Updated 5 years ago
• CLUEbenchmark / CLUEWSC2020
  CLUEWSC2020: WSC Winograd模式挑战中文版，中文指代消解任务
  ☆78Updated 5 years ago
• jiesutd / SubwordEncoding-CWS
  Subword Encoding in Lattice LSTM for Chinese Word Segmentation
  ☆54Updated 6 years ago
• zhongerqiandan / pretrained-unilm-Chinese
  中文版unilm预训练模型
  ☆83Updated 4 years ago
• Qznan / QizNLP
  Quick run NLP in many task 快速运行分类、序列标注、匹配、生成等NLP任务的Tensorflow框架 (中文 NLP 支持分布式）
  ☆31Updated 4 years ago
• chqiwang / convseg
  Convolutional neural network and word embeddings for Chinese word segmentation
  ☆146Updated 3 years ago
• CLUEbenchmark / PyCLUE
  Python toolkit for Chinese Language Understanding(CLUE) Evaluation benchmark
  ☆132Updated 2 years ago
• chatopera / wikidata-corpus
  Train Wikidata with word2vec for word embedding tasks
  ☆123Updated 7 years ago