lonePatient / MobileBert_PyTorch

Related projects: ⓘ

• intersun / PKD-for-BERT-Model-Compression
  pytorch implementation for Patient Knowledge Distillation for BERT Model Compression
  ☆198Updated 5 years ago
• lonePatient / electra_pytorch
  ELECTRA: Pre-training Text Encoders as Discriminators Rather Than Generators
  ☆91Updated 3 years ago
• bojone / r-drop
  R-Drop方法在中文任务上的简单实验
  ☆90Updated 2 years ago
• BitVoyage / FastBERT
  对ACL2020 FastBERT论文的复现，论文地址//arxiv.org/pdf/2004.02178.pdf
  ☆191Updated 2 years ago
• JetRunner / BERT-of-Theseus
  ⛵️The official PyTorch implementation for "BERT-of-Theseus: Compressing BERT by Progressive Module Replacing" (EMNLP 2020).
  ☆310Updated last year
• DunZhang / KnowledgeDistillation
  A general framework for knowledge distillation
  ☆48Updated 3 years ago
• maknotavailable / pytorch-pretrained-BERT
  A PyTorch implementation of Google AI's BERT model provided with Google's pre-trained models, examples and utilities.
  ☆68Updated 2 years ago
• wptoux / albert-chinese-large-webqa
  基于百度webqa与dureader数据集训练的Albert Large QA模型
  ☆75Updated 4 years ago
• lxk00 / BERT-EMD
  ☆50Updated last year
• yitu-opensource / ConvBert
  ☆245Updated last year
• yongbowin / pytorch-pretrained-BERT_annotation
  bert annotation, input and output for people from scratch, 代码注释, 有每一步的输入和输出, 适合初学者
  ☆92Updated last year
• CLUEbenchmark / MobileQA
  离线端阅读理解应用 QA for mobile, Android & iPhone
  ☆60Updated last year
• TsinghuaAI / CPM-1-Finetune
  Finetune CPM-1
  ☆75Updated last year
• shehzaadzd / pytorch-pretrained-BERT
  A PyTorch implementation of Google AI's BERT model provided with Google's pre-trained models, examples and utilities.
  ☆35Updated 5 years ago
• Christmas-Wong / paper_project
  论文模型复现
  ☆42Updated 2 years ago
• bojone / bert-of-theseus
  bert-of-theseus via bert4keras
  ☆31Updated 4 years ago
• NoviScl / BERT-RACE
  ☆80Updated last year
• kevinmtian / distill-bert
  Knowledge Distillation from BERT
  ☆51Updated 5 years ago
• CLUEbenchmark / LightLM
  高性能小模型测评 Shared Tasks in NLPCC 2020. Task 1 - Light Pre-Training Chinese Language Model for NLP Task
  ☆57Updated 4 years ago
• pmichel31415 / are-16-heads-really-better-than-1
  Code for the paper "Are Sixteen Heads Really Better than One?"
  ☆165Updated 4 years ago
• qiufengyuyi / bert-of-theseus-tf
  tensorflow version of bert-of-theseus
  ☆63Updated 3 years ago
• hrlinlp / cepsum
  ☆44Updated 2 years ago
• princeton-nlp / CoFiPruning
  [ACL 2022] Structured Pruning Learns Compact and Accurate Models https://arxiv.org/abs/2204.00408
  ☆188Updated last year
• microsoft / Unicoder
  Unicoder model for understanding and generation.
  ☆88Updated 9 months ago
• thuwyh / InferLight
  lightweighted deep learning inference service framework
  ☆38Updated 3 years ago
• dreamgonfly / transformer-pytorch
  A PyTorch implementation of Transformer in "Attention is All You Need"
  ☆103Updated 3 years ago
• napoler / reformer-chinese
  reformer-pytorch中文版本，简单高效的生成模型。类似GPT2的效果
  ☆16Updated last year
• TobiasLee / Awesome-Efficient-PLM
  Must-read papers on improving efficiency for pre-trained language models.
  ☆100Updated last year
• ChenRocks / Distill-BERT-Textgen
  Research code for ACL 2020 paper: "Distilling Knowledge Learned in BERT for Text Generation".
  ☆129Updated 3 years ago
• jd-aig / JAVE
  ☆85Updated 4 years ago