calpt / awesome-adapter-resources

Related projects: ⓘ

• prateeky2806 / ties-merging
  ☆136Updated 7 months ago
• EnnengYang / Awesome-Model-Merging-Methods-Theories-Applications
  Model Merging in LLMs, MLLMs, and Beyond: Methods, Theories, Applications and Opportunities. arXiv:2408.07666.
  ☆107Updated this week
• AGI-Edgerunners / LLM-Continual-Learning-Papers
  Must-read Papers on Large Language Model (LLM) Continual Learning
  ☆129Updated 10 months ago
• bloomberg / dataless-model-merging
  Code release for Dataless Knowledge Fusion by Merging Weights of Language Models (https://openreview.net/forum?id=FCnohuR6AnM)
  ☆80Updated last year
• locuslab / massive-activations
  Code accompanying the paper "Massive Activations in Large Language Models"
  ☆104Updated 6 months ago
• rabeehk / compacter
  ☆127Updated 2 years ago
• benzakenelad / BitFit
  Simple Parameter-efficient Fine-tuning for Transformer-based Masked Language-models
  ☆134Updated 2 years ago
• ylsung / Ladder-Side-Tuning
  PyTorch codes for "LST: Ladder Side-Tuning for Parameter and Memory Efficient Transfer Learning"
  ☆229Updated last year
• TsinghuaC3I / SoRA
  The source code of the EMNLP 2023 main conference paper: Sparse Low-rank Adaptation of Pre-trained Language Models.
  ☆62Updated 6 months ago
• morningmoni / UniPELT
  Code for paper "UniPELT: A Unified Framework for Parameter-Efficient Language Model Tuning", ACL 2022
  ☆58Updated 2 years ago
• alon-albalak / data-selection-survey
  A Survey on Data Selection for Language Models
  ☆148Updated 3 months ago
• XiangLi1999 / ContrastiveDecoding
  contrastive decoding
  ☆174Updated last year
• for-ai / parameter-efficient-moe
  ☆239Updated 10 months ago
• ycjing / Awesome-Model-Merging
  A curated list of Model Merging methods.
  ☆71Updated this week
• mmatena / model_merging
  ☆61Updated 2 years ago
• arazd / ProgressivePrompts
  Progressive Prompts: Continual Learning for Language Models
  ☆87Updated last year
• BeyonderXX / TRACE
  TRACE: A Comprehensive Benchmark for Continual Learning in Large Language Models
  ☆56Updated 7 months ago
• ZhengxiangShi / DePT
  [ICLR 2024] This is the repository for the paper titled "DePT: Decomposed Prompt Tuning for Parameter-Efficient Fine-tuning"
  ☆90Updated 5 months ago
• microsoft / rho
  Repo for Rho-1: Token-level Data Selection & Selective Pretraining of LLMs.
  ☆290Updated 5 months ago
• logix-project / logix
  AI Logging for Interpretability and Explainability🔬
  ☆74Updated 3 months ago
• xiaoya-li / Instruction-Tuning-Survey
  Project for the paper entitled `Instruction Tuning for Large Language Models: A Survey`
  ☆134Updated 6 months ago
• EnnengYang / AdaMerging
  AdaMerging: Adaptive Model Merging for Multi-Task Learning. ICLR, 2024.
  ☆40Updated 2 weeks ago
• Dongping-Chen / MLLM-Judge
  [ICML 2024 Oral] Official code repository for MLLM-as-a-Judge.
  ☆47Updated last month
• QingruZhang / AdaLoRA
  AdaLoRA: Adaptive Budget Allocation for Parameter-Efficient Fine-Tuning (ICLR 2023).
  ☆253Updated last year
• lucidrains / soft-moe-pytorch
  Implementation of Soft MoE, proposed by Brain's Vision team, in Pytorch
  ☆233Updated 4 months ago
• rabeehk / hyperformer
  ☆149Updated 3 years ago
• mlfoundations / task_vectors
  Editing Models with Task Arithmetic
  ☆405Updated 8 months ago
• GCYZSL / MoLA
  ☆110Updated last month
• cambridgeltl / autopeft
  AutoPEFT: Automatic Configuration Search for Parameter-Efficient Fine-Tuning (Zhou et al.; TACL)
  ☆42Updated 6 months ago
• huggingface / datablations
  Scaling Data-Constrained Language Models
  ☆310Updated this week