Alternatives and similar repositories for UniPELT

Users that are interested in UniPELT are comparing it to the libraries listed below

• AkariAsai / ATTEMPT
  This is the oficial repository for "Parameter-Efficient Multi-task Tuning via Attentional Mixtures of Soft Prompts" (EMNLP 2022)
  ☆102Updated 2 years ago
• ChaosCodes / ProPETL
  One Network, Many Masks: Towards More Parameter-Efficient Transfer Learning
  ☆40Updated 2 years ago
• JetRunner / SuperICL
  Code for "Small Models are Valuable Plug-ins for Large Language Models"
  ☆131Updated 2 years ago
• BenfengXu / KNNPrompting
  Released code for our ICLR23 paper.
  ☆65Updated 2 years ago
• ShiZhengyan / DePT
  [ICLR 2024] This is the repository for the paper titled "DePT: Decomposed Prompt Tuning for Parameter-Efficient Fine-tuning"
  ☆95Updated last year
• rabeehk / hyperformer
  ☆157Updated 3 years ago
• OhadRubin / EPR
  ☆63Updated 2 years ago
• fuzihaofzh / AnalyzeParameterEfficientFinetune
  On the Effectiveness of Parameter-Efficient Fine-Tuning
  ☆38Updated last year
• llyx97 / TAMT
  [NAACL 2022] "Learning to Win Lottery Tickets in BERT Transfer via Task-agnostic Mask Training", Yuanxin Liu, Fandong Meng, Zheng Lin, Pe…
  ☆15Updated 2 years ago
• XiangLi1999 / ContrastiveDecoding
  contrastive decoding
  ☆203Updated 2 years ago
• hkust-nlp / PEM_composition
  [NeurIPS 2023] Github repository for "Composing Parameter-Efficient Modules with Arithmetic Operations"
  ☆61Updated last year
• HillZhang1999 / ICD
  Code & Data for our Paper "Alleviating Hallucinations of Large Language Models through Induced Hallucinations"
  ☆68Updated last year
• BaohaoLiao / mefts
  [NeurIPS 2023] Make Your Pre-trained Model Reversible: From Parameter to Memory Efficient Fine-Tuning
  ☆31Updated 2 years ago
• JetRunner / MetaDistil
  Code for ACL 2022 paper "BERT Learns to Teach: Knowledge Distillation with Meta Learning".
  ☆86Updated 3 years ago
• DRSY / EMO
  [ICLR 2024]EMO: Earth Mover Distance Optimization for Auto-Regressive Language Modeling(https://arxiv.org/abs/2310.04691)
  ☆123Updated last year
• qcwthu / Lifelong-Fewshot-Language-Learning
  The code for lifelong few-shot language learning
  ☆55Updated 3 years ago
• benzakenelad / BitFit
  Simple Parameter-efficient Fine-tuning for Transformer-based Masked Language-models
  ☆142Updated 2 years ago
• yizhongw / llm-temporal-alignment
  Methods and evaluation for aligning language models temporally
  ☆29Updated last year
• Shark-NLP / self-adaptive-ICL
  self-adaptive in-context learning
  ☆45Updated 2 years ago
• zjunlp / DART
  [ICLR 2022] Differentiable Prompt Makes Pre-trained Language Models Better Few-shot Learners
  ☆132Updated 2 years ago
• AGI-Edgerunners / LLM-Continual-Learning-Papers
  Must-read Papers on Large Language Model (LLM) Continual Learning
  ☆144Updated last year
• Hzfinfdu / MPMP
  ACL'2023: Multi-Task Pre-Training of Modular Prompt for Few-Shot Learning
  ☆40Updated 2 years ago
• wutong8023 / PLM4CL
  ICLR 2022
  ☆17Updated 3 years ago
• ChicagoHAI / active-example-selection
  Active Example Selection for In-Context Learning (EMNLP'22)
  ☆49Updated last year
• cambridgeltl / autopeft
  AutoPEFT: Automatic Configuration Search for Parameter-Efficient Fine-Tuning (Zhou et al.; TACL 2024)
  ☆46Updated last year
• cxcscmu / MATES
  Official repository for MATES: Model-Aware Data Selection for Efficient Pretraining with Data Influence Models [NeurIPS 2024]
  ☆73Updated 8 months ago
• Alsace08 / SumCoT
  [ACL 2023] Code and Data Repo for Paper "Element-aware Summary and Summary Chain-of-Thought (SumCoT)"
  ☆54Updated last year
• Hunter-DDM / stablemoe
  Code for the ACL-2022 paper "StableMoE: Stable Routing Strategy for Mixture of Experts"
  ☆48Updated 3 years ago
• lancopku / DynamicKD
  Code for EMNLP 2021 main conference paper "Dynamic Knowledge Distillation for Pre-trained Language Models"
  ☆41Updated 3 years ago
• FranxYao / FlanT5-CoT-Specialization
  Implementation of ICML 23 Paper: Specializing Smaller Language Models towards Multi-Step Reasoning.
  ☆131Updated 2 years ago