Alternatives and similar repositories for Chinese_tokenizer_benchmark

Users that are interested in Chinese_tokenizer_benchmark are comparing it to the libraries listed below

• yuikns / icwb2-data
  This directory contains the training, test, and gold-standard data used in the 2nd International Chinese Word Segmentation Bakeoff. Also …
  ☆67Updated 6 years ago
• bojone / chinese-gen
  中文生成式预训练模型
  ☆98Updated 4 years ago
• jiesutd / SubwordEncoding-CWS
  Subword Encoding in Lattice LSTM for Chinese Word Segmentation
  ☆53Updated 6 years ago
• NCXiaozui / New-Word-Detection
  新词发现算法(NewWordDetection)
  ☆62Updated 7 years ago
• CLUEbenchmark / LightLM
  高性能小模型测评 Shared Tasks in NLPCC 2020. Task 1 - Light Pre-Training Chinese Language Model for NLP Task
  ☆58Updated 4 years ago
• SVAIGBA / TwASP
  ☆74Updated 2 years ago
• UniversalDependencies / UD_Chinese-GSD
  ☆93Updated last week
• Rayarrow / New-Word-Discovery
  新词发现 基于词频、凝聚系数和左右邻接信息熵
  ☆122Updated 5 years ago
• howl-anderson / corpus_dataset_for_Chinese_NLP
  中文 NLP 语料库数据集
  ☆20Updated 6 years ago
• CLUEbenchmark / DistilBert
  DistilBERT for Chinese 海量中文预训练蒸馏bert模型
  ☆92Updated 5 years ago
• bojone / perturbed_masking
  基于BERT的无监督分词和句法分析
  ☆110Updated 4 years ago
• tiandiweizun / chinese-segmentation-evaluation
  中文分词工具评估
  ☆61Updated 2 years ago
• flowers2023 / lm-ken
  kenlm语言模型，并提供python的rest服务
  ☆29Updated 6 years ago
• CLUEbenchmark / PyCLUE
  Python toolkit for Chinese Language Understanding(CLUE) Evaluation benchmark
  ☆129Updated last year
• thunlp / THUCKE
  THU Chinese Keyphrase Extraction Toolkit
  ☆124Updated 7 years ago
• bojone / nlp-zero
  基于最小熵原理的NLP工具包
  ☆137Updated 3 years ago
• CLUEbenchmark / CLUEWSC2020
  CLUEWSC2020: WSC Winograd模式挑战中文版，中文指代消解任务
  ☆75Updated 4 years ago
• chenhui-bupt / PeopleDaily1998
  人民日报1998年1-4月中文标注语料库
  ☆32Updated 6 years ago
• wangmuy / awesome-nlp-chinese-corpus
  A curated list of resources of chinese corpora for NLP(Natural Language Processing)
  ☆75Updated 5 years ago
• charlesXu86 / char_featurizer
  汉字字符特征提取工具，可以提取出字符中的字音（声母、韵母、声调）、字形（偏旁、部首）、四角编码等特征，同时可作为tensor输入到模型
  ☆137Updated 4 years ago
• HillZhang1999 / CTC-Report
  CTC2021-中文文本纠错大赛的SOTA方案及在线演示
  ☆72Updated last year
• ymcui / Chinese-Cloze-RC
  A Chinese Cloze-style RC Dataset: People's Daily & Children's Fairy Tale (CFT)
  ☆170Updated 6 years ago
• chatopera / text-dependency-parser
  依存关系分析，NLP，自然语言处理
  ☆85Updated 3 years ago
• zhaoyyoo / NLPCC2018_GEC
  The dataset and the evaluation tool for NLPCC2018 Shared Task2--Grammatical Error Correction (GEC).
  ☆55Updated 3 years ago
• HITlilingzhi / SMP2017ECDT-DATA
  SMP2017中文人机对话评测数据
  ☆107Updated 7 years ago
• wonderfulsuccess / chinese_abstractive_corpus
  教育行业新闻 自动文摘 语料库 自动摘要
  ☆199Updated 6 years ago
• LG-1 / video_music_book_datasets
  NLP NER datasets video/music/book bio
  ☆88Updated 4 years ago
• ownthink / evaluation
  各大中文分词性能评测
  ☆157Updated 6 years ago
• liuhuanyong / ChineseTextualInference
  ChineseTextualInference project including chinese corpus build and inferecence model, 中文文本推断项目,包括88万文本蕴含中文文本蕴含数据集的翻译与构建,基于深度学习的文本蕴含判定模型构建…
  ☆173Updated 6 years ago
• HIT-SCIR / SemEval-2016
  SemEval-2016 Task 9: Chinese Semantic Dependency Parsing
  ☆135Updated 7 years ago