Alternatives and similar repositories for compacter

Users that are interested in compacter are comparing it to the libraries listed below

• benzakenelad / BitFit
  Simple Parameter-efficient Fine-tuning for Transformer-based Masked Language-models
  ☆142Updated 2 years ago
• rabeehk / hyperformer
  ☆155Updated 3 years ago
• microsoft / AdaMix
  This is the implementation of the paper AdaMix: Mixture-of-Adaptations for Parameter-efficient Model Tuning (https://arxiv.org/abs/2205.1…
  ☆133Updated last year
• AkariAsai / ATTEMPT
  This is the oficial repository for "Parameter-Efficient Multi-task Tuning via Attentional Mixtures of Soft Prompts" (EMNLP 2022)
  ☆102Updated 2 years ago
• McGill-NLP / polytropon
  ☆54Updated 2 years ago
• mmatena / model_merging
  ☆69Updated 3 years ago
• kernelmachine / demix
  DEMix Layers for Modular Language Modeling
  ☆53Updated 3 years ago
• arazd / ProgressivePrompts
  Progressive Prompts: Continual Learning for Language Models
  ☆93Updated 2 years ago
• john-hewitt / backpacks-flash-attn
  The original Backpack Language Model implementation, a fork of FlashAttention
  ☆69Updated 2 years ago
• uds-lsv / MCSE
  NAACL 2022: MCSE: Multimodal Contrastive Learning of Sentence Embeddings
  ☆55Updated last year
• machelreid / diffuser
  DiffusER: Discrete Diffusion via Edit-based Reconstruction (Reid, Hellendoorn & Neubig, 2022)
  ☆54Updated 2 years ago
• bloomberg / dataless-model-merging
  Code release for Dataless Knowledge Fusion by Merging Weights of Language Models (https://openreview.net/forum?id=FCnohuR6AnM)
  ☆89Updated last year
• BaohaoLiao / mefts
  [NeurIPS 2023] Make Your Pre-trained Model Reversible: From Parameter to Memory Efficient Fine-Tuning
  ☆31Updated 2 years ago
• e-bug / iglue
  [ICML 2022] Code and data for our paper "IGLUE: A Benchmark for Transfer Learning across Modalities, Tasks, and Languages"
  ☆49Updated 2 years ago
• fuzihaofzh / AnalyzeParameterEfficientFinetune
  On the Effectiveness of Parameter-Efficient Fine-Tuning
  ☆38Updated last year
• eric-mitchell / mend
  MEND: Fast Model Editing at Scale
  ☆245Updated last year
• qcwthu / Lifelong-Fewshot-Language-Learning
  The code for lifelong few-shot language learning
  ☆55Updated 3 years ago
• cliang1453 / SAGE
  No Parameters Left Behind: Sensitivity Guided Adaptive Learning Rate for Training Large Transformer Models (ICLR 2022)
  ☆30Updated 3 years ago
• rosewang2008 / language_modeling_via_stochastic_processes
  Language modeling via stochastic processes. Oral @ ICLR 2022.
  ☆138Updated 2 years ago
• SALT-NLP / Adaptive-Compositional-Modules
  Code for the ACL 2022 paper "Continual Sequence Generation with Adaptive Compositional Modules"
  ☆38Updated 3 years ago
• XiangLi1999 / ContrastiveDecoding
  contrastive decoding
  ☆201Updated 2 years ago
• VITA-Group / Random-MoE-as-Dropout
  [ICLR 2023] "Sparse MoE as the New Dropout: Scaling Dense and Self-Slimmable Transformers" by Tianlong Chen*, Zhenyu Zhang*, Ajay Jaiswal…
  ☆52Updated 2 years ago
• HKUNLP / icl-ceil
  [ICML 2023] Code for our paper “Compositional Exemplars for In-context Learning”.
  ☆101Updated 2 years ago
• morningmoni / UniPELT
  Code for paper "UniPELT: A Unified Framework for Parameter-Efficient Language Model Tuning", ACL 2022
  ☆61Updated 3 years ago
• Hunter-DDM / stablemoe
  Code for the ACL-2022 paper "StableMoE: Stable Routing Strategy for Mixture of Experts"
  ☆47Updated 2 years ago
• nayeon7lee / FactualityPrompt
  ☆86Updated 2 years ago
• haoliuhl / language-quantized-autoencoders
  Language Quantized AutoEncoders
  ☆107Updated 2 years ago
• cambridgeltl / composable-sft
  A library for parameter-efficient and composable transfer learning for NLP with sparse fine-tunings.
  ☆73Updated 10 months ago
• jiacheng-ye / ZeroGen
  [EMNLP 2022] Code for our paper “ZeroGen: Efficient Zero-shot Learning via Dataset Generation”.
  ☆48Updated 3 years ago
• jzbjyb / ReAtt
  Retrieval as Attention
  ☆82Updated 2 years ago