This is the implementation of the paper AdaMix: Mixture-of-Adaptations for Parameter-efficient Model Tuning (https://arxiv.org/abs/2205.12410).
☆136Aug 14, 2023Updated 2 years ago
Alternatives and similar repositories for AdaMix
Users that are interested in AdaMix are comparing it to the libraries listed below
Sorting:
- AutoPEFT: Automatic Configuration Search for Parameter-Efficient Fine-Tuning (Zhou et al.; TACL 2024)☆51Mar 17, 2024Updated last year
- ☆15Jun 22, 2022Updated 3 years ago
- Anh - LAION's multilingual assistant datasets and models☆27Apr 5, 2023Updated 2 years ago
- [TPAMI] Searching prompt modules for parameter-efficient transfer learning.☆238Dec 8, 2023Updated 2 years ago
- This package implements THOR: Transformer with Stochastic Experts.☆65Oct 7, 2021Updated 4 years ago
- Code for paper "UniPELT: A Unified Framework for Parameter-Efficient Language Model Tuning", ACL 2022☆63Mar 23, 2022Updated 3 years ago
- Collection of Tools and Papers related to Adapters / Parameter-Efficient Transfer Learning/ Fine-Tuning☆201May 4, 2024Updated last year
- Code for T-Few from "Few-Shot Parameter-Efficient Fine-Tuning is Better and Cheaper than In-Context Learning"☆456Sep 6, 2023Updated 2 years ago
- Implementation of paper "Towards a Unified View of Parameter-Efficient Transfer Learning" (ICLR 2022)☆543Mar 24, 2022Updated 3 years ago
- This is the oficial repository for "Parameter-Efficient Multi-task Tuning via Attentional Mixtures of Soft Prompts" (EMNLP 2022)☆104Dec 1, 2022Updated 3 years ago
- ☆77Apr 29, 2024Updated last year
- https://liuzeming01.github.io/XDailyDialog/☆13Jun 25, 2023Updated 2 years ago
- ☆13Feb 2, 2023Updated 3 years ago
- PyTorch codes for "LST: Ladder Side-Tuning for Parameter and Memory Efficient Transfer Learning"☆241Jan 20, 2023Updated 3 years ago
- Code for the paper Self-Supervised Learning of Split Invariant Equivariant Representations☆31Sep 4, 2023Updated 2 years ago
- A Unified Library for Parameter-Efficient and Modular Transfer Learning☆2,801Oct 12, 2025Updated 4 months ago
- Codebase for ACL 2023 paper "Mixture-of-Domain-Adapters: Decoupling and Injecting Domain Knowledge to Pre-trained Language Models' Memori…☆52Oct 8, 2023Updated 2 years ago
- Code release for Dataless Knowledge Fusion by Merging Weights of Language Models (https://openreview.net/forum?id=FCnohuR6AnM)☆93Jul 25, 2023Updated 2 years ago
- ☆75Jul 2, 2021Updated 4 years ago
- The released data for paper "Measuring and Improving Chain-of-Thought Reasoning in Vision-Language Models".☆34Sep 16, 2023Updated 2 years ago
- ☆131Aug 18, 2022Updated 3 years ago
- ☆274Oct 31, 2023Updated 2 years ago
- DEMix Layers for Modular Language Modeling☆54Updated this week
- A package dedicated for running benchmark agreement testing☆17Sep 18, 2025Updated 5 months ago
- ☆32Jul 16, 2025Updated 7 months ago
- The source code of our work "Prepacking: A Simple Method for Fast Prefilling and Increased Throughput in Large Language Models" [AISTATS …☆60Oct 11, 2024Updated last year
- [CVPR 2022] PyTorch implementation of Hierarchical Contrastive Selective Coding (HCSC) (https://arxiv.org/abs/2202.00455)☆133Mar 22, 2022Updated 3 years ago
- ☆35Mar 2, 2023Updated 3 years ago
- Syphus: Automatic Instruction-Response Generation Pipeline☆14Dec 14, 2023Updated 2 years ago
- ☆18May 25, 2022Updated 3 years ago
- Code for the Findings of NAACL 2022(Long Paper): AdapterBias: Parameter-efficient Token-dependent Representation Shift for Adapters in NL…☆18May 4, 2022Updated 3 years ago
- A family of efficient edge language models in 100M~1B sizes.☆19Feb 14, 2025Updated last year
- Manage scalable open LLM inference endpoints in Slurm clusters☆282Jul 11, 2024Updated last year
- A plug-and-play library for parameter-efficient-tuning (Delta Tuning)☆1,039Sep 19, 2024Updated last year
- Latent Diffusion Language Models☆70Sep 20, 2023Updated 2 years ago
- [COLM 2024] LoraHub: Efficient Cross-Task Generalization via Dynamic LoRA Composition☆669Jul 22, 2024Updated last year
- Prefix-Tuning: Optimizing Continuous Prompts for Generation☆958Apr 26, 2024Updated last year
- Code for NeurIPS 2022 paper “S-Prompts Learning with Pre-trained Transformers: An Occam’s Razor for Domain Incremental Learning“☆106Sep 26, 2024Updated last year
- ☆19Sep 15, 2022Updated 3 years ago