calpt / awesome-adapter-resourcesLinks
Collection of Tools and Papers related to Adapters / Parameter-Efficient Transfer Learning/ Fine-Tuning
☆200Updated last year
Alternatives and similar repositories for awesome-adapter-resources
Users that are interested in awesome-adapter-resources are comparing it to the libraries listed below
Sorting:
- ☆200Updated last year
- Residual Prompt Tuning: a method for faster and better prompt tuning.☆56Updated 2 years ago
- [ICLR 2024] This is the repository for the paper titled "DePT: Decomposed Prompt Tuning for Parameter-Efficient Fine-tuning"☆99Updated last year
- [EMNLP 2023, Main Conference] Sparse Low-rank Adaptation of Pre-trained Language Models☆85Updated last year
- Code for paper "UniPELT: A Unified Framework for Parameter-Efficient Language Model Tuning", ACL 2022☆63Updated 3 years ago
- Fine-tuning Vision Transformers on various classification datasets☆112Updated last year
- ☆130Updated 3 years ago
- Code release for Dataless Knowledge Fusion by Merging Weights of Language Models (https://openreview.net/forum?id=FCnohuR6AnM)☆92Updated 2 years ago
- AutoPEFT: Automatic Configuration Search for Parameter-Efficient Fine-Tuning (Zhou et al.; TACL 2024)☆50Updated last year
- A curated list of Model Merging methods.☆92Updated last year
- ☆43Updated 2 years ago
- Model soups: averaging weights of multiple fine-tuned models improves accuracy without increasing inference time☆499Updated last year
- Simple Parameter-efficient Fine-tuning for Transformer-based Masked Language-models☆143Updated 3 years ago
- Must-read Papers on Large Language Model (LLM) Continual Learning☆148Updated 2 years ago
- AdaMerging: Adaptive Model Merging for Multi-Task Learning. ICLR, 2024.☆97Updated last year
- A framework for merging models solving different tasks with different initializations into one multi-task model without any additional tr…☆307Updated last year
- Code accompanying the paper "Massive Activations in Large Language Models"☆187Updated last year
- PyTorch codes for "LST: Ladder Side-Tuning for Parameter and Memory Efficient Transfer Learning"☆242Updated 2 years ago
- ☆134Updated 8 months ago
- ☆80Updated 3 years ago
- Official code for "TOAST: Transfer Learning via Attention Steering"☆188Updated 2 years ago
- The official implementation of the paper "What Matters in Transformers? Not All Attention is Needed".☆181Updated 3 weeks ago
- PyTorch implementation of LIMoE☆52Updated last year
- A collection of parameter-efficient transfer learning papers focusing on computer vision and multimodal domains.☆410Updated last year
- [NeurIPS 2023] Make Your Pre-trained Model Reversible: From Parameter to Memory Efficient Fine-Tuning☆33Updated 2 years ago
- ☆186Updated last year
- Progressive Prompts: Continual Learning for Language Models☆98Updated 2 years ago
- Editing Models with Task Arithmetic☆515Updated last year
- Awesome Learn From Model Beyond Fine-Tuning: A Survey☆78Updated 11 months ago
- Code for "SemDeDup", a simple method for identifying and removing semantic duplicates from a dataset (data pairs which are semantically s…☆147Updated 2 years ago