Alternatives and similar repositories for libtorch_tokenizer

Users that are interested in libtorch_tokenizer are comparing it to the libraries listed below

• zejunwang1 / easytokenizer
  高性能文本 Tokenizer 库
  ☆31Updated last year
• dhpollack / huggingface_libtorch
  Minimal example of using a traced huggingface transformers model with libtorch
  ☆36Updated 5 years ago
• LieluoboAi / radish
  C++ model train&inference framework
  ☆222Updated 5 years ago
• LeeJuly30 / BERTCpp
  implement bert in pure c++
  ☆36Updated 5 years ago
• thuwyh / InferLight
  lightweighted deep learning inference service framework
  ☆40Updated 4 years ago
• ymcui / Chinese-MobileBERT
  Chinese MobileBERT（中文MobileBERT模型）
  ☆96Updated 3 years ago
• CLUEbenchmark / MobileQA
  离线端阅读理解应用 QA for mobile, Android & iPhone
  ☆60Updated 3 years ago
• mattzheng / py-kenlm-model
  python | 高效使用统计语言模型kenlm：新词发现、分词、智能纠错等
  ☆168Updated 6 years ago
• Tlntin / ChatGLM2-6B-TensorRT
  ☆90Updated 2 years ago
• Peter-Chou / transformer_cpp_tokenizers
  transformer tokenizers (e.g. BERT tokenizer) in C++ (WIP)
  ☆17Updated 3 years ago
• CLUEbenchmark / PyCLUE
  Python toolkit for Chinese Language Understanding(CLUE) Evaluation benchmark
  ☆132Updated 2 years ago
• jiangtaojy / mlm_bert_traning
  基于mlm方式的带有纠错功能的拼音转汉字bert预训练模型，pinyin correcter，基于pytorch框架实现
  ☆47Updated 4 years ago
• tongchangD / bert_for_corrector
  基于bert进行中文文本纠错
  ☆237Updated 2 years ago
• pluto-junzeng / C4-zh
  大规模中文语料
  ☆44Updated 5 years ago
• zhongerqiandan / pretrained-unilm-Chinese
  中文版unilm预训练模型
  ☆83Updated 4 years ago
• charlesXu86 / char_featurizer
  汉字字符特征提取工具，可以提取出字符中的字音（声母、韵母、声调）、字形（偏旁、部首）、四角编码等特征，同时可作为tensor输入到模型
  ☆137Updated 5 years ago
• zejunwang1 / bert4vec
  一个基于预训练的句向量生成工具
  ☆137Updated 2 years ago
• ZhuiyiTechnology / roformer-v2
  RoFormer升级版
  ☆154Updated 3 years ago
• yanqiuxia / BERT-PreTrain
  不用tensorflow estimator，分别采用字mask和wwm mask在中文领域内finetune bert模型
  ☆23Updated 5 years ago
• bitallin / MiduCTC-competition
  文本智能校对大赛(Chinese Text Correction)的baseline
  ☆68Updated 3 years ago
• zhusleep / tagger_rewriter
  对话改写介绍文章
  ☆98Updated 2 years ago
• 425776024 / lasertagger-chinese
  lasertagger-chinese；lasertagger中文学习案例，案例数据，注释，shell运行
  ☆76Updated 2 years ago
• taishan1994 / Gector_chinese
  基于seq2edit (Gector) 的中文文本纠错。
  ☆29Updated 2 years ago
• alibaba-damo-academy / SpokenNLP
  A wide variety of research projects developed by the SpokenNLP team of Speech Lab, Alibaba Group.
  ☆117Updated 4 months ago
• bojone / nezha_gpt_dialog
  ☆102Updated 5 years ago
• Mitomzhou / ASRT_SR_tensorflow2.0
  基于深度学习识别THCHS30数据集
  ☆14Updated 3 years ago
• Lisennlp / TinyBert
  简洁易用版TinyBert：基于Bert进行知识蒸馏的预训练语言模型
  ☆268Updated 4 years ago
• liushulinle / PLOME
  Source code for the paper "PLOME: Pre-training with Misspelled Knowledge for Chinese Spelling Correction" in ACL2021
  ☆239Updated 3 years ago
• yuanzhoulvpi2017 / quick_sentence_transformers
  sentence-transformers to onnx 让sbert模型推理效率更快
  ☆166Updated 3 years ago
• BitVoyage / FastBERT
  对ACL2020 FastBERT论文的复现，论文地址//arxiv.org/pdf/2004.02178.pdf
  ☆194Updated 3 years ago