Alternatives and similar repositories for structured-pruning-adapters:

Users that are interested in structured-pruning-adapters are comparing it to the libraries listed below

• BaohaoLiao / mefts
  [NeurIPS 2023] Make Your Pre-trained Model Reversible: From Parameter to Memory Efficient Fine-Tuning
  ☆31Updated last year
• TencentARC / pi-Tuning
  Official code for "pi-Tuning: Transferring Multimodal Foundation Models with Optimal Multi-task Interpolation", ICML 2023.
  ☆32Updated last year
• OpenGVLab / LLMPrune-BESA
  BESA is a differentiable weight pruning technique for large language models.
  ☆14Updated last year
• VITA-Group / Junk_DNA_Hypothesis
  [ICML 2024] Junk DNA Hypothesis: A Task-Centric Angle of LLM Pre-trained Weights through Sparsity; Lu Yin*, Ajay Jaiswal*, Shiwei Liu, So…
  ☆16Updated 9 months ago
• locuslab / llava-token-compression
  ☆39Updated 4 months ago
• swaggy-TN / EfficientVLM
  EfficientVLM: Fast and Accurate Vision-Language Models via Knowledge Distillation and Modal-adaptive Pruning (ACL 2023)
  ☆24Updated last year
• shoaibahmed / llm_depth_pruning
  Official implementation of the paper: "A deeper look at depth pruning of LLMs"
  ☆14Updated 7 months ago
• csarron / PuMer
  [ACL 2023] PuMer: Pruning and Merging Tokens for Efficient Vision Language Models
  ☆29Updated 5 months ago
• fuzihaofzh / AnalyzeParameterEfficientFinetune
  On the Effectiveness of Parameter-Efficient Fine-Tuning
  ☆38Updated last year
• locuslab / T-MARS
  Code for T-MARS data filtering
  ☆35Updated last year
• twinkle0331 / LGTM
  [ACL 2023] Code for paper “Tailoring Instructions to Student’s Learning Levels Boosts Knowledge Distillation”(https://arxiv.org/abs/2305.…
  ☆38Updated last year
• mlvlab / DAPT
  Distribution-Aware Prompt Tuning for Vision-Language Models (ICCV 2023)
  ☆38Updated last year
• VITA-Group / Random-MoE-as-Dropout
  [ICLR 2023] "Sparse MoE as the New Dropout: Scaling Dense and Self-Slimmable Transformers" by Tianlong Chen*, Zhenyu Zhang*, Ajay Jaiswal…
  ☆48Updated 2 years ago
• boyazeng / understand_bias
  Code release for "Understanding Bias in Large-Scale Visual Datasets"
  ☆19Updated 3 months ago
• wjxts / RegularizedBN
  ☆21Updated 2 years ago
• salesforce / ensemble-of-averages
  ☆29Updated last year
• Mxbonn / ltmp
  Code for Learned Thresholds Token Merging and Pruning for Vision Transformers (LTMP). A technique to reduce the size of Vision Transforme…
  ☆14Updated 3 months ago
• alexandertheus / Intra-Fusion
  Towards Meta-Pruning via Optimal Transport, ICLR 2024 (Spotlight)
  ☆16Updated 3 months ago
• rgeirhos / dataset-pruning-metrics
  Metrics for "Beyond neural scaling laws: beating power law scaling via data pruning " (NeurIPS 2022 Outstanding Paper Award)
  ☆55Updated last year
• Pbihao / SLM
  ☆26Updated 11 months ago
• VITA-Group / Robust_Weight_Signatures
  [ICML 2023] "Robust Weight Signatures: Gaining Robustness as Easy as Patching Weights?" by Ruisi Cai, Zhenyu Zhang, Zhangyang Wang
  ☆15Updated last year
• BatsResearch / ex2
  If CLIP Could Talk: Understanding Vision-Language Model Representations Through Their Preferred Concept Descriptions
  ☆15Updated 11 months ago
• mshukor / eP-ALM
  [ICCV23] Official implementation of eP-ALM: Efficient Perceptual Augmentation of Language Models.
  ☆27Updated last year
• yikangshen / MoA
  Mixture of Attention Heads
  ☆41Updated 2 years ago
• ggjy / vision_weak_to_strong
  ☆38Updated last year
• tianyi-lab / Mosaic-IT
  Mosaic IT: Enhancing Instruction Tuning with Data Mosaics
  ☆17Updated last month
• d-ailin / CLIP-Guided-Decoding
  ☆16Updated 7 months ago
• AllanYangZhou / generative-invariance-transfer
  ☆26Updated 3 years ago
• mlfoundations / clip_quality_not_quantity
  ☆29Updated 2 years ago