JunnYu / RoFormer_pytorch

Related projects ⓘ

Alternatives and complementary repositories for RoFormer_pytorch

• ZhuiyiTechnology / roformer
  Rotary Transformer
  ☆811Updated 2 years ago
• fastnlp / CPT
  CPT: A Pre-Trained Unbalanced Transformer for Both Chinese Language Understanding and Generation
  ☆481Updated last year
• autoliuweijie / BERT-whitening-pytorch
  Pytorch version of BERT-whitening
  ☆310Updated 3 years ago
• yym6472 / ConSERT
  Code for our ACL 2021 paper - ConSERT: A Contrastive Framework for Self-Supervised Sentence Representation Transfer
  ☆539Updated 2 years ago
• Lisennlp / TinyBert
  简洁易用版TinyBert：基于Bert进行知识蒸馏的预训练语言模型
  ☆252Updated 4 years ago
• ZhuiyiTechnology / GAU-alpha
  基于Gated Attention Unit的Transformer模型（尝鲜版）
  ☆97Updated last year
• bojone / bytepiece
  更纯粹、更高压缩率的Tokenizer
  ☆447Updated 6 months ago
• bojone / SimCSE
  SimCSE在中文任务上的简单实验
  ☆591Updated last year
• ZhuiyiTechnology / roformer-v2
  RoFormer升级版
  ☆150Updated 2 years ago
• dropreg / R-Drop
  ☆870Updated 5 months ago
• MuQiuJun-AI / bert4pytorch
  超轻量级bert的pytorch版本，大量中文注释，容易修改结构，持续更新
  ☆406Updated 2 years ago
• shawroad / CoSENT_Pytorch
  CoSENT、STS、SentenceBERT
  ☆162Updated last year
• bojone / BERT-whitening
  简单的向量白化改善句向量质量
  ☆481Updated 3 years ago
• ZhuiyiTechnology / roformer-sim
  SimBERT升级版（SimBERTv2）！
  ☆438Updated 2 years ago
• renmada / t5-pegasus-pytorch
  ☆402Updated 8 months ago
• xinyi-code / SimCSE-Pytorch
  中文数据集下SimCSE+ESimCSE的实现
  ☆188Updated 2 years ago
• yangjianxin1 / SimCSE
  SimCSE有监督与无监督实验复现
  ☆145Updated 8 months ago
• gaohongkui / GlobalPointer_pytorch
  全局指针统一处理嵌套与非嵌套NER的Pytorch实现
  ☆380Updated last year
• ShannonAI / ChineseBert
  Code for ACL 2021 paper "ChineseBERT: Chinese Pretraining Enhanced by Glyph and Pinyin Information"
  ☆541Updated last year
• lonePatient / NeZha_Chinese_PyTorch
  NEZHA: Neural Contextualized Representation for Chinese Language Understanding
  ☆262Updated 3 years ago
• CLUEbenchmark / FewCLUE
  FewCLUE 小样本学习测评基准，中文版
  ☆494Updated 2 years ago
• pluto-junzeng / CNSD
  中文自然语言推理数据集（A large-scale Chinese Nature language inference and Semantic similarity calculation Dataset）
  ☆424Updated 4 years ago
• bojone / CoSENT
  比Sentence-BERT更有效的句向量方案
  ☆358Updated 2 years ago
• vdogmcgee / SimCSE-Chinese-Pytorch
  SimCSE在中文上的复现，有监督+无监督
  ☆265Updated 2 years ago
• sunzeyeah / RLHF
  Implementation of Chinese ChatGPT
  ☆286Updated 11 months ago
• OpenBMB / ModelCenter
  Efficient, Low-Resource, Distributed transformer implementation based on BMTrain
  ☆238Updated 11 months ago
• zhengyanzhao1997 / NLP-model
  ☆275Updated 2 years ago
• Alibaba-NLP / Multi-CPR
  [SIGIR 2022] Multi-CPR: A Multi Domain Chinese Dataset for Passage Retrieval
  ☆170Updated last year
• xinyi-code / NLP-Loss-Pytorch
  Implementation of some unbalanced loss like focal_loss, dice_loss, DSC Loss, GHM Loss et.al
  ☆254Updated last year
• THUDM / P-tuning
  A novel method to tune language models. Codes and datasets for paper ``GPT understands, too''.
  ☆923Updated 2 years ago