Alternatives and similar repositories for TinyBERT

Users that are interested in TinyBERT are comparing it to the libraries listed below

• linzehui / mRASP
  ☆167Updated 4 years ago
• FLC777 / GLAT
  Implementation of "Glancing Transformer for Non-Autoregressive Neural Machine Translation"
  ☆137Updated 2 years ago
• TsinghuaAI / CPM-1-Pretrain
  Pretrain CPM-1
  ☆52Updated 4 years ago
• TsinghuaAI / CPM-1-Finetune
  Finetune CPM-1
  ☆75Updated 2 years ago
• alibaba-damo-academy / SpokenNLP
  A wide variety of research projects developed by the SpokenNLP team of Speech Lab, Alibaba Group.
  ☆123Updated 7 months ago
• fastnlp / ElasticBERT
  A pre-trained model with multi-exit transformer architecture.
  ☆56Updated 3 years ago
• TsinghuaAI / CUGE
  ☆54Updated 3 years ago
• ZhuiyiTechnology / GAU-alpha
  基于Gated Attention Unit的Transformer模型（尝鲜版）
  ☆98Updated 2 years ago
• bytedance / ParaGen
  ParaGen is a PyTorch deep learning framework for parallel sequence generation.
  ☆185Updated 3 years ago
• princeton-nlp / CoFiPruning
  [ACL 2022] Structured Pruning Learns Compact and Accurate Models https://arxiv.org/abs/2204.00408
  ☆198Updated 2 years ago
• BlinkDL / minGPT-tuned
  A *tuned* minimal PyTorch re-implementation of the OpenAI GPT (Generative Pretrained Transformer) training
  ☆119Updated 4 years ago
• PANXiao1994 / mRASP2
  ☆120Updated 4 years ago
• TsinghuaAI / CPM
  Introduction to CPM
  ☆165Updated 4 years ago
• TsinghuaAI / CPM-2-Pretrain
  Code for CPM-2 Pre-Train
  ☆158Updated 2 years ago
• Nealcly / MuTual
  A Dataset for Multi-Turn Dialogue Reasoning
  ☆333Updated 5 years ago
• lxk00 / BERT-EMD
  ☆50Updated 2 years ago
• beyondguo / genius
  💡GENIUS – generating text using sketches! A strong text generation & data augmentation tool.
  ☆181Updated 3 years ago
• intersun / PKD-for-BERT-Model-Compression
  pytorch implementation for Patient Knowledge Distillation for BERT Model Compression
  ☆204Updated 6 years ago
• Jxu-Thu / DITTO
  The code of paper "Learning to Break the Loop: Analyzing and Mitigating Repetitions for Neural Text Generation" published at NeurIPS 202…
  ☆48Updated 3 years ago
• pluto-junzeng / C4-zh
  大规模中文语料
  ☆44Updated 6 years ago
• yitu-opensource / ConvBert
  ☆254Updated 3 years ago
• ZhuiyiTechnology / roformer-v2
  RoFormer升级版
  ☆154Updated 3 years ago
• TsinghuaAI / CPM-2-Finetune
  Finetune CPM-2
  ☆81Updated 2 years ago
• JunnYu / FLASHQuad_pytorch
  FLASHQuad_pytorch
  ☆68Updated 3 years ago
• airaria / TextPruner
  A PyTorch-based model pruning toolkit for pre-trained language models
  ☆388Updated 2 years ago
• siat-nlp / GALAXY
  Official repository of the AAAI'2022 paper "GALAXY: A Generative Pre-trained Model for Task-Oriented Dialog with Semi-Supervised Learning…
  ☆108Updated 3 years ago
• chujiezheng / ChID-Dataset
  ChID: A Large-scale Chinese IDiom Dataset for Cloze Test
  ☆151Updated 2 years ago
• qhjqhj00 / SIGIR2021-Pchatbot
  ☆82Updated 2 years ago
• Lisennlp / TinyBert
  简洁易用版TinyBert：基于Bert进行知识蒸馏的预训练语言模型
  ☆268Updated 5 years ago
• LooperXX / AGIF
  Open source code for EMNLP 2020 Findings Paper "AGIF: An Adaptive Graph-Interactive Framework for Joint Multiple Intent Detection and Slo…
  ☆87Updated 4 years ago