Alternatives and similar repositories for RoFormer_pytorch:

Users that are interested in RoFormer_pytorch are comparing it to the libraries listed below

• ZhuiyiTechnology / roformer
  Rotary Transformer
  ☆900Updated 2 years ago
• fastnlp / CPT
  CPT: A Pre-Trained Unbalanced Transformer for Both Chinese Language Understanding and Generation
  ☆487Updated 2 years ago
• dropreg / R-Drop
  ☆873Updated 9 months ago
• ZhuiyiTechnology / GAU-alpha
  基于Gated Attention Unit的Transformer模型（尝鲜版）
  ☆97Updated 2 years ago
• MuQiuJun-AI / bert4pytorch
  超轻量级bert的pytorch版本，大量中文注释，容易修改结构，持续更新
  ☆414Updated 2 years ago
• autoliuweijie / BERT-whitening-pytorch
  Pytorch version of BERT-whitening
  ☆308Updated 3 years ago
• ZhuiyiTechnology / roformer-v2
  RoFormer升级版
  ☆151Updated 2 years ago
• taishan1994 / sentencepiece_chinese_bpe
  使用sentencepiece中BPE训练中文词表，并在transformers中进行使用。
  ☆116Updated last year
• Lisennlp / TinyBert
  简洁易用版TinyBert：基于Bert进行知识蒸馏的预训练语言模型
  ☆259Updated 4 years ago
• yym6472 / ConSERT
  Code for our ACL 2021 paper - ConSERT: A Contrastive Framework for Self-Supervised Sentence Representation Transfer
  ☆539Updated 3 years ago
• bojone / bytepiece
  更纯粹、更高压缩率的Tokenizer
  ☆470Updated 3 months ago
• bojone / SimCSE
  SimCSE在中文任务上的简单实验
  ☆602Updated last year
• ShannonAI / ChineseBert
  Code for ACL 2021 paper "ChineseBERT: Chinese Pretraining Enhanced by Glyph and Pinyin Information"
  ☆550Updated last year
• bojone / BERT-whitening
  简单的向量白化改善句向量质量
  ☆484Updated 3 years ago
• lonePatient / NeZha_Chinese_PyTorch
  NEZHA: Neural Contextualized Representation for Chinese Language Understanding
  ☆262Updated 3 years ago
• ZhuiyiTechnology / roformer-sim
  SimBERT升级版（SimBERTv2）！
  ☆441Updated 2 years ago
• Doragd / Awesome-Sentence-Embedding
  A curated list of research papers in Sentence Reprsentation Learning and a sts leaderboard of sentence embeddings.
  ☆313Updated last year
• xinyi-code / SimCSE-Pytorch
  中文数据集下SimCSE+ESimCSE的实现
  ☆191Updated 2 years ago
• renmada / t5-pegasus-pytorch
  ☆411Updated last year
• vdogmcgee / SimCSE-Chinese-Pytorch
  SimCSE在中文上的复现，有监督+无监督
  ☆272Updated last week
• CLUEbenchmark / FewCLUE
  FewCLUE 小样本学习测评基准，中文版
  ☆502Updated 2 years ago
• shawroad / CoSENT_Pytorch
  CoSENT、STS、SentenceBERT
  ☆163Updated 3 weeks ago
• universal-ie / UIE
  Unified Structure Generation for Universal Information Extraction
  ☆915Updated 2 years ago
• SunnyGJing / t5-pegasus-chinese
  基于GOOGLE T5中文生成式模型的摘要生成/指代消解，支持batch批量生成，多进程
  ☆219Updated last year
• gaohongkui / GlobalPointer_pytorch
  全局指针统一处理嵌套与非嵌套NER的Pytorch实现
  ☆385Updated last year
• zhusleep / pytorch_chinese_lm_pretrain
  pytorch中文语言模型预训练
  ☆389Updated 4 years ago
• destwang / CTCResources
  ☆265Updated 7 months ago
• bojone / CoSENT
  比Sentence-BERT更有效的句向量方案
  ☆366Updated 2 years ago
• lemon234071 / clean-dialog
  A framework for cleaning Chinese dialog data
  ☆267Updated 3 years ago
• JunnYu / FLASHQuad_pytorch
  FLASHQuad_pytorch
  ☆67Updated 2 years ago