Alternatives and similar repositories for DynamicKD:

Users that are interested in DynamicKD are comparing it to the libraries listed below

• llyx97 / sparse-and-robust-PLM
  [NeurIPS 2022] "A Win-win Deal: Towards Sparse and Robust Pre-trained Language Models", Yuanxin Liu, Fandong Meng, Zheng Lin, Jiangnan Li…
  ☆21Updated last year
• lancopku / MUKI
  [Findings of EMNLP22] From Mimicking to Integrating: Knowledge Integration for Pre-Trained Language Models
  ☆19Updated 2 years ago
• llyx97 / TAMT
  [NAACL 2022] "Learning to Win Lottery Tickets in BERT Transfer via Task-agnostic Mask Training", Yuanxin Liu, Fandong Meng, Zheng Lin, Pe…
  ☆15Updated 2 years ago
• GeneZC / MiniMoE
  Code for ACL 2023 paper titled "Lifting the Curse of Capacity Gap in Distilling Language Models"
  ☆28Updated last year
• lancopku / CascadeBERT
  Code for CascadeBERT, Findings of EMNLP 2021
  ☆12Updated 3 years ago
• qcwthu / Lifelong-Fewshot-Language-Learning
  The code for lifelong few-shot language learning
  ☆55Updated 3 years ago
• RunxinXu / ChildTuning
  Source code for our EMNLP'21 paper 《Raise a Child in Large Language Model: Towards Effective and Generalizable Fine-tuning》
  ☆60Updated 3 years ago
• TobiasLee / VEC
  Visual and Embodied Concepts evaluation benchmark
  ☆21Updated last year
• tongshoujie / MATCH-TUNING
  MATCH-TUNING
  ☆15Updated 2 years ago
• Hunter-DDM / stablemoe
  Code for the ACL-2022 paper "StableMoE: Stable Routing Strategy for Mixture of Experts"
  ☆45Updated 2 years ago
• pkunlp-icler / ChildTuning
  ☆33Updated 3 years ago
• txsun1997 / Metric-Fairness
  EMNLP'2022: BERTScore is Unfair: On Social Bias in Language Model-Based Metrics for Text Generation
  ☆41Updated 2 years ago
• JetRunner / MetaDistil
  Code for ACL 2022 paper "BERT Learns to Teach: Knowledge Distillation with Meta Learning".
  ☆86Updated 2 years ago
• thunlp / TR-BERT
  Source code for NAACL 2021 paper "TR-BERT: Dynamic Token Reduction for Accelerating BERT Inference"
  ☆47Updated 2 years ago
• RunxinXu / ContrastivePruning
  Source code for our AAAI'22 paper 《From Dense to Sparse: Contrastive Pruning for Better Pre-trained Language Model Compression》
  ☆24Updated 3 years ago
• thunlp / MixADA
  ☆20Updated 3 years ago
• Victorwz / VaLM
  VaLM: Visually-augmented Language Modeling. ICLR 2023.
  ☆56Updated 2 years ago
• ChaosCodes / ProPETL
  One Network, Many Masks: Towards More Parameter-Efficient Transfer Learning
  ☆39Updated last year
• lemon0830 / promptCSE
  code for promptCSE, emnlp 2022
  ☆11Updated 2 years ago
• ptlmasking / maskbert
  ☆20Updated 4 years ago
• fuzihaofzh / AnalyzeParameterEfficientFinetune
  On the Effectiveness of Parameter-Efficient Fine-Tuning
  ☆38Updated last year
• TobiasLee / ChineseNER
  CLUENER2020 Chinese NER task
  ☆11Updated 3 years ago
• Wangpeiyi9979 / ESD
  Code for NAACL2022 Long Paper "An Enhanced Span-based Decomposition Method for Few-Shot Sequence Labeling"
  ☆28Updated 2 years ago
• gmftbyGMFTBY / MomentumDecoding
  Momentum Decoding: Open-ended Text Generation as Graph Exploration
  ☆19Updated 2 years ago
• zhaominyiz / EPiDA
  Official Code for 'EPiDA: An Easy Plug-in Data Augmentation Framework for High Performance Text Classification' - NAACL 2022
  ☆23Updated 3 years ago
• yikangshen / MoA
  Mixture of Attention Heads
  ☆44Updated 2 years ago
• twinkle0331 / LGTM
  [ACL 2023] Code for paper “Tailoring Instructions to Student’s Learning Levels Boosts Knowledge Distillation”(https://arxiv.org/abs/2305.…
  ☆38Updated last year
• yhy1117 / X-Mixup
  Implementation of ICLR 2022 paper "Enhancing Cross-lingual Transfer by Manifold Mixup".
  ☆21Updated 2 years ago
• dqxiu / KAssess
  ☆15Updated last year
• TianduoWang / DiffAug
  [EMNLP 2022] Differentiable Data Augmentation for Contrastive Sentence Representation Learning. https://arxiv.org/abs/2210.16536
  ☆40Updated 2 years ago