Alternatives and similar repositories for UniPELT:

Users that are interested in UniPELT are comparing it to the libraries listed below

• AkariAsai / ATTEMPT
  This is the oficial repository for "Parameter-Efficient Multi-task Tuning via Attentional Mixtures of Soft Prompts" (EMNLP 2022)
  ☆100Updated 2 years ago
• BenfengXu / KNNPrompting
  Released code for our ICLR23 paper.
  ☆63Updated last year
• ChaosCodes / ProPETL
  One Network, Many Masks: Towards More Parameter-Efficient Transfer Learning
  ☆38Updated last year
• BeyonderXX / TRACE
  TRACE: A Comprehensive Benchmark for Continual Learning in Large Language Models
  ☆64Updated last year
• benzakenelad / BitFit
  Simple Parameter-efficient Fine-tuning for Transformer-based Masked Language-models
  ☆138Updated 2 years ago
• DRSY / EMO
  [ICLR 2024]EMO: Earth Mover Distance Optimization for Auto-Regressive Language Modeling(https://arxiv.org/abs/2310.04691)
  ☆119Updated 11 months ago
• fuzihaofzh / AnalyzeParameterEfficientFinetune
  On the Effectiveness of Parameter-Efficient Fine-Tuning
  ☆38Updated last year
• hkust-nlp / PEM_composition
  [NeurIPS 2023] Github repository for "Composing Parameter-Efficient Modules with Arithmetic Operations"
  ☆60Updated last year
• BaohaoLiao / mefts
  [NeurIPS 2023] Make Your Pre-trained Model Reversible: From Parameter to Memory Efficient Fine-Tuning
  ☆30Updated last year
• qcwthu / Lifelong-Fewshot-Language-Learning
  The code for lifelong few-shot language learning
  ☆55Updated 3 years ago
• rabeehk / hyperformer
  ☆152Updated 3 years ago
• OhadRubin / EPR
  ☆60Updated 2 years ago
• wangpf3 / consistent-CoT-distillation
  ☆39Updated last year
• TsinghuaC3I / SoRA
  [EMNLP 2023 Main] Sparse Low-rank Adaptation of Pre-trained Language Models
  ☆72Updated 11 months ago
• uds-lsv / MCSE
  NAACL 2022: MCSE: Multimodal Contrastive Learning of Sentence Embeddings
  ☆55Updated 8 months ago
• Shwai-He / MEO
  The source code of "Merging Experts into One: Improving Computational Efficiency of Mixture of Experts (EMNLP 2023)":
  ☆35Updated 10 months ago
• nayeon7lee / FactualityPrompt
  ☆85Updated 2 years ago
• ZhengxiangShi / DePT
  [ICLR 2024] This is the repository for the paper titled "DePT: Decomposed Prompt Tuning for Parameter-Efficient Fine-tuning"
  ☆96Updated 10 months ago
• Shark-NLP / self-adaptive-ICL
  self-adaptive in-context learning
  ☆44Updated last year
• r-three / smear
  ☆27Updated last year
• gyhdog99 / MoCLE
  MoCLE (First MLLM with MoE for instruction customization and generalization!) (https://arxiv.org/abs/2312.12379)
  ☆33Updated 10 months ago
• xiami2019 / CLAIF
  [Findings of ACL'2023] Improving Contrastive Learning of Sentence Embeddings from AI Feedback
  ☆39Updated last year
• john-hewitt / backpacks-flash-attn
  The original Backpack Language Model implementation, a fork of FlashAttention
  ☆66Updated last year
• princeton-nlp / QuRating
  [ICML 2024] Selecting High-Quality Data for Training Language Models
  ☆157Updated 8 months ago
• lancopku / DynamicKD
  Code for EMNLP 2021 main conference paper "Dynamic Knowledge Distillation for Pre-trained Language Models"
  ☆40Updated 2 years ago
• RunxinXu / ChildTuning
  Source code for our EMNLP'21 paper 《Raise a Child in Large Language Model: Towards Effective and Generalizable Fine-tuning》
  ☆57Updated 3 years ago
• wutong8023 / PLM4CL
  ICLR 2022
  ☆17Updated 2 years ago
• guanzhchen / PETuning
  ☆33Updated last year
• GeneZC / MiniMoE
  Code for ACL 2023 paper titled "Lifting the Curse of Capacity Gap in Distilling Language Models"
  ☆28Updated last year
• circle-hit / SAPT
  Code for ACL 2024 accepted paper titled "SAPT: A Shared Attention Framework for Parameter-Efficient Continual Learning of Large Language …
  ☆29Updated last month