Alternatives and similar repositories for MobileBert_PyTorch

Users that are interested in MobileBert_PyTorch are comparing it to the libraries listed below

• intersun / PKD-for-BERT-Model-Compression
  pytorch implementation for Patient Knowledge Distillation for BERT Model Compression
  ☆203Updated 6 years ago
• yitu-opensource / ConvBert
  ☆254Updated 3 years ago
• dreamgonfly / transformer-pytorch
  A PyTorch implementation of Transformer in "Attention is All You Need"
  ☆106Updated 4 years ago
• JetRunner / BERT-of-Theseus
  ⛵️The official PyTorch implementation for "BERT-of-Theseus: Compressing BERT by Progressive Module Replacing" (EMNLP 2020).
  ☆316Updated 2 years ago
• CLUEbenchmark / MobileQA
  离线端阅读理解应用 QA for mobile, Android & iPhone
  ☆60Updated 3 years ago
• DunZhang / KnowledgeDistillation
  A general framework for knowledge distillation
  ☆55Updated 5 years ago
• napoler / reformer-chinese
  reformer-pytorch中文版本，简单高效的生成模型。类似GPT2的效果
  ☆16Updated 2 years ago
• lonePatient / electra_pytorch
  ELECTRA: Pre-training Text Encoders as Discriminators Rather Than Generators
  ☆91Updated 4 years ago
• bojone / shuffle
  Python下shuffle几百G文件
  ☆33Updated 4 years ago
• wptoux / albert-chinese-large-webqa
  基于百度webqa与dureader数据集训练的Albert Large QA模型
  ☆77Updated 5 years ago
• thuwyh / InferLight
  lightweighted deep learning inference service framework
  ☆39Updated 4 years ago
• princeton-nlp / CoFiPruning
  [ACL 2022] Structured Pruning Learns Compact and Accurate Models https://arxiv.org/abs/2204.00408
  ☆197Updated 2 years ago
• CLUEbenchmark / LightLM
  高性能小模型测评 Shared Tasks in NLPCC 2020. Task 1 - Light Pre-Training Chinese Language Model for NLP Task
  ☆60Updated 5 years ago
• TsinghuaAI / CPM-1-Finetune
  Finetune CPM-1
  ☆75Updated 2 years ago
• ymcui / Chinese-MobileBERT
  Chinese MobileBERT（中文MobileBERT模型）
  ☆97Updated 3 years ago
• dreamgonfly / BERT-pytorch
  PyTorch implementation of BERT in "BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding"
  ☆110Updated 7 years ago
• castorini / DeeBERT
  DeeBERT: Dynamic Early Exiting for Accelerating BERT Inference
  ☆160Updated 3 years ago
• cheneydon / efficient-bert
  This repository contains the code for the paper in Findings of EMNLP 2021: "EfficientBERT: Progressively Searching Multilayer Perceptron …
  ☆33Updated 2 years ago
• MAC-AutoML / YOCO-BERT
  The official implementation of You Only Compress Once: Towards Effective and Elastic BERT Compression via Exploit-Explore Stochastic Natu…
  ☆48Updated 4 years ago
• pvgladkov / knowledge-distillation
  PyTorch implementations of algorithms for knowledge distillation.
  ☆57Updated 5 years ago
• lxk00 / BERT-EMD
  ☆50Updated 2 years ago
• cloneofsimo / realformer-pytorch
  Implementation of RealFormer using pytorch
  ☆101Updated 4 years ago
• BitVoyage / FastBERT
  对ACL2020 FastBERT论文的复现，论文地址//arxiv.org/pdf/2004.02178.pdf
  ☆194Updated 3 years ago
• thunlp / TR-BERT
  Source code for NAACL 2021 paper "TR-BERT: Dynamic Token Reduction for Accelerating BERT Inference"
  ☆48Updated 3 years ago
• robeld / ERNIE
  Open Source Neural Machine Translation in PyTorch
  ☆17Updated 6 years ago
• IBM / PoWER-BERT
  Method to improve inference time for BERT. This is an implementation of the paper titled "PoWER-BERT: Accelerating BERT Inference via Pro…
  ☆62Updated 2 months ago
• Lisennlp / TinyBert
  简洁易用版TinyBert：基于Bert进行知识蒸馏的预训练语言模型
  ☆268Updated 5 years ago
• jd-aig / JAVE
  ☆88Updated 5 years ago
• lonePatient / ERNIE-text-classification-pytorch
  This repo contains a PyTorch implementation of a pretrained ERNIE model for text classification.
  ☆59Updated 3 years ago
• LeeJuly30 / BERTCpp
  implement bert in pure c++
  ☆36Updated 5 years ago