Alternatives and similar repositories for TinyBERT

Users that are interested in TinyBERT are comparing it to the libraries listed below

• linzehui / mRASP
  ☆167Updated 4 years ago
• TsinghuaAI / CPM-1-Pretrain
  Pretrain CPM-1
  ☆52Updated 4 years ago
• intersun / PKD-for-BERT-Model-Compression
  pytorch implementation for Patient Knowledge Distillation for BERT Model Compression
  ☆203Updated 6 years ago
• TsinghuaAI / CPM-1-Finetune
  Finetune CPM-1
  ☆75Updated 2 years ago
• FLC777 / GLAT
  Implementation of "Glancing Transformer for Non-Autoregressive Neural Machine Translation"
  ☆137Updated 2 years ago
• ZhuiyiTechnology / roformer-v2
  RoFormer升级版
  ☆154Updated 3 years ago
• bytedance / ParaGen
  ParaGen is a PyTorch deep learning framework for parallel sequence generation.
  ☆185Updated 3 years ago
• JunnYu / FLASHQuad_pytorch
  FLASHQuad_pytorch
  ☆68Updated 3 years ago
• lonePatient / electra_pytorch
  ELECTRA: Pre-training Text Encoders as Discriminators Rather Than Generators
  ☆91Updated 4 years ago
• lemon234071 / TransformerBaselines
  ☆23Updated 5 years ago
• alibaba-damo-academy / SpokenNLP
  A wide variety of research projects developed by the SpokenNLP team of Speech Lab, Alibaba Group.
  ☆124Updated 8 months ago
• wakafengfan / simcse-pytorch
  pytorch版simcse无监督语义相似模型
  ☆23Updated 4 years ago
• ZhuiyiTechnology / GAU-alpha
  基于Gated Attention Unit的Transformer模型（尝鲜版）
  ☆98Updated 2 years ago
• PANXiao1994 / mRASP2
  ☆120Updated 4 years ago
• WENGSYX / Low-resource-text-translation
  科大讯飞低资源多语种文本翻译挑战赛获奖方案
  ☆27Updated 2 years ago
• Jxu-Thu / DITTO
  The code of paper "Learning to Break the Loop: Analyzing and Mitigating Repetitions for Neural Text Generation" published at NeurIPS 202…
  ☆48Updated 3 years ago
• TsinghuaAI / CUGE
  ☆54Updated 3 years ago
• lonePatient / MobileBert_PyTorch
  MobileBERT: a Compact Task-Agnostic BERT for Resource-Limited Devices
  ☆71Updated 5 years ago
• jcyk / BERT
  a simple yet complete implementation of the popular BERT model
  ☆128Updated 5 years ago
• TsinghuaAI / CPM-2-Pretrain
  Code for CPM-2 Pre-Train
  ☆158Updated 2 years ago
• Nealcly / MuTual
  A Dataset for Multi-Turn Dialogue Reasoning
  ☆332Updated 5 years ago
• yyht / BERT
  modification of official bert for downstream task
  ☆32Updated 2 years ago
• ProjectD-AI / LLaMA-Megatron-DeepSpeed
  Ongoing research training transformer language models at scale, including: BERT & GPT-2
  ☆69Updated 2 years ago
• dqwang122 / MLROUGE
  ROUGE for multilingual Summarization
  ☆25Updated 4 years ago
• lxk00 / BERT-EMD
  ☆50Updated 2 years ago
• Lisennlp / TinyBert
  简洁易用版TinyBert：基于Bert进行知识蒸馏的预训练语言模型
  ☆270Updated 5 years ago
• qywu / Chinese-GPT
  Chinese Transformer Generative Pre-Training Model
  ☆59Updated 6 years ago
• TsinghuaAI / CPM-2-Finetune
  Finetune CPM-2
  ☆81Updated 2 years ago
• AutoTemp / Shallow-Aggressive-Decoding
  Codes for the paper "Instantaneous Grammatical Error Correction with Shallow Aggressive Decoding" (ACL-IJCNLP 2021)
  ☆41Updated 4 years ago
• fastnlp / ElasticBERT
  A pre-trained model with multi-exit transformer architecture.
  ☆56Updated 3 years ago