Alternatives and similar repositories for Chinese_tokenizer_benchmark

Users that are interested in Chinese_tokenizer_benchmark are comparing it to the libraries listed below

• yuikns / icwb2-data
  This directory contains the training, test, and gold-standard data used in the 2nd International Chinese Word Segmentation Bakeoff. Also …
  ☆67Updated 7 years ago
• SVAIGBA / TwASP
  ☆74Updated 2 years ago
• bojone / chinese-gen
  中文生成式预训练模型
  ☆98Updated 4 years ago
• UniversalDependencies / UD_Chinese-GSD
  ☆93Updated last week
• jiesutd / SubwordEncoding-CWS
  Subword Encoding in Lattice LSTM for Chinese Word Segmentation
  ☆53Updated 6 years ago
• howl-anderson / corpus_dataset_for_Chinese_NLP
  中文 NLP 语料库数据集
  ☆20Updated 6 years ago
• CLUEbenchmark / DistilBert
  DistilBERT for Chinese 海量中文预训练蒸馏bert模型
  ☆92Updated 5 years ago
• zhongerqiandan / pretrained-unilm-Chinese
  中文版unilm预训练模型
  ☆83Updated 4 years ago
• bojone / nlp-zero
  基于最小熵原理的NLP工具包
  ☆137Updated 3 years ago
• shijiebei2009 / CEEC-Corpus
  中文环境突发事件语料库（Chinese Environment Emergency Corpus）-上海大学-语义智能实验室
  ☆46Updated 9 years ago
• CLUEbenchmark / PyCLUE
  Python toolkit for Chinese Language Understanding(CLUE) Evaluation benchmark
  ☆129Updated 2 years ago
• NCXiaozui / New-Word-Detection
  新词发现算法(NewWordDetection)
  ☆62Updated 7 years ago
• chenhui-bupt / PeopleDaily1998
  人民日报1998年1-4月中文标注语料库
  ☆32Updated 6 years ago
• bojone / perturbed_masking
  基于BERT的无监督分词和句法分析
  ☆110Updated 5 years ago
• zhangkaixu / minitools
  minitools
  ☆103Updated 11 years ago
• flowers2023 / lm-ken
  kenlm语言模型，并提供python的rest服务
  ☆29Updated 6 years ago
• thunlp / THUCKE
  THU Chinese Keyphrase Extraction Toolkit
  ☆124Updated 7 years ago
• phychaos / pycrfpp
  python CRF++实现分词
  ☆37Updated 7 years ago
• Rayarrow / New-Word-Discovery
  新词发现 基于词频、凝聚系数和左右邻接信息熵
  ☆122Updated 5 years ago
• pluto-junzeng / C4-zh
  大规模中文语料
  ☆42Updated 5 years ago
• li-aolong / li-aolong.github.io
  李傲龍的博客
  ☆82Updated 11 months ago
• HITlilingzhi / SMP2017ECDT-DATA
  SMP2017中文人机对话评测数据
  ☆107Updated 7 years ago
• hankcs / TreebankPreprocessing
  Python scripts preprocessing Penn Treebank and Chinese Treebank
  ☆162Updated 4 years ago
• liuhuanyong / ChineseTextualInference
  ChineseTextualInference project including chinese corpus build and inferecence model, 中文文本推断项目,包括88万文本蕴含中文文本蕴含数据集的翻译与构建,基于深度学习的文本蕴含判定模型构建…
  ☆172Updated 6 years ago
• chatopera / text-dependency-parser
  依存关系分析，NLP，自然语言处理
  ☆85Updated 3 years ago
• CLUEbenchmark / CLUEWSC2020
  CLUEWSC2020: WSC Winograd模式挑战中文版，中文指代消解任务
  ☆75Updated 5 years ago
• zhangyi24 / sentence_transformer_zh
  ☆32Updated 4 years ago
• dalinvip / pytorch_Joint-Word-Segmentation-and-POS-Tagging
  Paper: A Simple and Effective Neural Model for Joint Word Segmentation and POS Tagging
  ☆35Updated 6 years ago
• HKUST-KnowComp / JWE
  Joint Embeddings of Chinese Words, Characters, and Fine-grained Subcharacter Components
  ☆99Updated 6 years ago
• thu-coai / tatk
  Task-oriented dialog system toolkits
  ☆85Updated 2 years ago