calpt / awesome-adapter-resources
Collection of Tools and Papers related to Adapters / Parameter-Efficient Transfer Learning/ Fine-Tuning
☆168Updated 4 months ago
Related projects: ⓘ
- ☆136Updated 7 months ago
- Model Merging in LLMs, MLLMs, and Beyond: Methods, Theories, Applications and Opportunities. arXiv:2408.07666.☆107Updated this week
- Must-read Papers on Large Language Model (LLM) Continual Learning☆129Updated 10 months ago
- Code release for Dataless Knowledge Fusion by Merging Weights of Language Models (https://openreview.net/forum?id=FCnohuR6AnM)☆80Updated last year
- Code accompanying the paper "Massive Activations in Large Language Models"☆104Updated 6 months ago
- ☆127Updated 2 years ago
- Simple Parameter-efficient Fine-tuning for Transformer-based Masked Language-models☆134Updated 2 years ago
- PyTorch codes for "LST: Ladder Side-Tuning for Parameter and Memory Efficient Transfer Learning"☆229Updated last year
- The source code of the EMNLP 2023 main conference paper: Sparse Low-rank Adaptation of Pre-trained Language Models.☆62Updated 6 months ago
- Code for paper "UniPELT: A Unified Framework for Parameter-Efficient Language Model Tuning", ACL 2022☆58Updated 2 years ago
- A Survey on Data Selection for Language Models☆148Updated 3 months ago
- contrastive decoding☆174Updated last year
- ☆239Updated 10 months ago
- A curated list of Model Merging methods.☆71Updated this week
- ☆61Updated 2 years ago
- Progressive Prompts: Continual Learning for Language Models☆87Updated last year
- TRACE: A Comprehensive Benchmark for Continual Learning in Large Language Models☆56Updated 7 months ago
- [ICLR 2024] This is the repository for the paper titled "DePT: Decomposed Prompt Tuning for Parameter-Efficient Fine-tuning"☆90Updated 5 months ago
- Repo for Rho-1: Token-level Data Selection & Selective Pretraining of LLMs.☆290Updated 5 months ago
- AI Logging for Interpretability and Explainability🔬☆74Updated 3 months ago
- Project for the paper entitled `Instruction Tuning for Large Language Models: A Survey`☆134Updated 6 months ago
- AdaMerging: Adaptive Model Merging for Multi-Task Learning. ICLR, 2024.☆40Updated 2 weeks ago
- [ICML 2024 Oral] Official code repository for MLLM-as-a-Judge.☆47Updated last month
- AdaLoRA: Adaptive Budget Allocation for Parameter-Efficient Fine-Tuning (ICLR 2023).☆253Updated last year
- Implementation of Soft MoE, proposed by Brain's Vision team, in Pytorch☆233Updated 4 months ago
- ☆149Updated 3 years ago
- Editing Models with Task Arithmetic☆405Updated 8 months ago
- ☆110Updated last month
- AutoPEFT: Automatic Configuration Search for Parameter-Efficient Fine-Tuning (Zhou et al.; TACL)☆42Updated 6 months ago
- Scaling Data-Constrained Language Models☆310Updated this week