Alternatives and similar repositories for pytorch-PKD-for-BERT-compression:

Users that are interested in pytorch-PKD-for-BERT-compression are comparing it to the libraries listed below

• LinyangLee / Token-Aware-VAT
  Code for our AAAI2021 paper: Token-Aware Virtual Adversarial Training For Language Understanding.
  ☆25Updated 4 years ago
• zzysay / KD4NRE
  Example code for paper "Distilling Knowledge from Well-informed Soft Labels for Neural Relation Extraction" (AAAI 2020).
  ☆22Updated 5 years ago
• pkunlp-icler / GroupMeeting
  Group Meeting Record for Baobao Chang Group in Peking University
  ☆25Updated 3 years ago
• tongshoujie / MATCH-TUNING
  MATCH-TUNING
  ☆15Updated 2 years ago
• TobiasLee / Awesome-Efficient-PLM
  Must-read papers on improving efficiency for pre-trained language models.
  ☆102Updated 2 years ago
• wakafengfan / simcse-pytorch
  pytorch版simcse无监督语义相似模型
  ☆22Updated 3 years ago
• zsweet / zsw_AI_model
  ☆12Updated 6 years ago
• RunxinXu / ChildTuning
  Source code for our EMNLP'21 paper 《Raise a Child in Large Language Model: Towards Effective and Generalizable Fine-tuning》
  ☆57Updated 3 years ago
• zhouj8553 / FlipDA
  ☆65Updated 9 months ago
• LorrinWWW / SkipBERT
  Code associated with the paper **SkipBERT: Efficient Inference with Shallow Layer Skipping**, at ACL 2022
  ☆16Updated 2 years ago
• dinghanshen / Cutoff
  The source code for the Cutoff data augmentation approach proposed in this paper: "A Simple but Tough-to-Beat Data Augmentation Approach …
  ☆62Updated 4 years ago
• HwwAncient / Pytorch-PLATO
  PLATO dialog model with pre-trained parameters in pytorch version
  ☆29Updated 2 years ago
• LeeSureman / Sequence-Labeling-Early-Exit
  Code for ACL 2021 paper: Accelerating BERT Inference for Sequence Labeling via Early-Exit
  ☆28Updated 2 years ago
• cjhaitman / bert_seq2seq
  pytorch实现bert做seq2seq任务，使用unilm方案。
  ☆10Updated 4 years ago
• siat-nlp / TTOS
  Official repository of the EMNLP'2020 paper "Amalgamating Knowledge from Two Teachers for Task-oriented Dialogue System with Adversarial …
  ☆16Updated 3 years ago
• lancopku / CascadeBERT
  Code for CascadeBERT, Findings of EMNLP 2021
  ☆12Updated 2 years ago
• WangJiuniu / adversarial_training
  Pytorch implementation of the methods proposed in **Adversarial Training Methods for Semi-Supervised Text Classification** on IMDB datase…
  ☆42Updated 5 years ago
• GeneZC / MiniMoE
  Code for ACL 2023 paper titled "Lifting the Curse of Capacity Gap in Distilling Language Models"
  ☆28Updated last year
• yizhen20133868 / Retriever-Dialogue
  end-to-end dialog system dataset
  ☆12Updated 5 years ago
• Zeng-WH / Prompt-Tuning
  Implementation of "The Power of Scale for Parameter-Efficient Prompt Tuning"
  ☆57Updated 2 years ago
• NoviScl / AdvRACE
  ☆19Updated 3 years ago
• nvshrao / Cross-Review-Curriculum-Strategy
  Implementation of "Curriculum Learning for Natural Language Understanding" (xu et. al. 2020)
  ☆12Updated 4 years ago
• luciusssss / why-learn-shortcut
  [ACL'21 Findings] Why Machine Reading Comprehension Models Learn Shortcuts?
  ☆16Updated last year
• INK-USC / fewNER
  Good Examples Make A Faster Learner: Simple Demonstration-based Learning for Low-resource NER (ACL 2022)
  ☆43Updated 2 years ago
• lonePatient / BERT-SDA
  A PyTorch implementation of "Improving BERT Fine-Tuning via Self-Ensemble and Self-Distillation"
  ☆56Updated 4 years ago
• RUCAIBox / VDA
  Virtual Data Augmentation: A Robust and General Framework for Fine-tuning Pre-trained Models
  ☆16Updated 3 years ago
• caskcsg / TextSmoothing
  ☆34Updated 2 years ago
• chqiwang / sa-nmt
  semi-autoregressive neural machine translation
  ☆23Updated 6 years ago
• xashru / mixup-text
  Exploring mixup strategies for text classification
  ☆30Updated 4 years ago
• RunxinXu / ContrastivePruning
  Source code for our AAAI'22 paper 《From Dense to Sparse: Contrastive Pruning for Better Pre-trained Language Model Compression》
  ☆23Updated 3 years ago