Alternatives and similar repositories for structured-pruning-adapters

Users that are interested in structured-pruning-adapters are comparing it to the libraries listed below

• BaohaoLiao / mefts
  [NeurIPS 2023] Make Your Pre-trained Model Reversible: From Parameter to Memory Efficient Fine-Tuning
  ☆31Updated 2 years ago
• OpenGVLab / LLMPrune-BESA
  BESA is a differentiable weight pruning technique for large language models.
  ☆17Updated last year
• TencentARC / pi-Tuning
  Official code for "pi-Tuning: Transferring Multimodal Foundation Models with Optimal Multi-task Interpolation", ICML 2023.
  ☆33Updated 2 years ago
• MingSun-Tse / Why-the-State-of-Pruning-so-Confusing
  [Preprint] Why is the State of Neural Network Pruning so Confusing? On the Fairness, Comparison Setup, and Trainability in Network Prunin…
  ☆40Updated 2 months ago
• VITA-Group / Random-MoE-as-Dropout
  [ICLR 2023] "Sparse MoE as the New Dropout: Scaling Dense and Self-Slimmable Transformers" by Tianlong Chen*, Zhenyu Zhang*, Ajay Jaiswal…
  ☆55Updated 2 years ago
• locuslab / T-MARS
  Code for T-MARS data filtering
  ☆35Updated 2 years ago
• lapisrocks / DiscreteAdversarialDistillation
  [NeurIPS 2023] Official repository for "Distilling Out-of-Distribution Robustness from Vision-Language Foundation Models"
  ☆12Updated last year
• andyjm3 / SLTrain
  SLTrain: a sparse plus low-rank approach for parameter and memory efficient pretraining (NeurIPS 2024)
  ☆35Updated last year
• wjxts / RegularizedBN
  ☆21Updated 2 years ago
• VITA-Group / instant_soup
  [ICML2023] Instant Soup Cheap Pruning Ensembles in A Single Pass Can Draw Lottery Tickets from Large Models. Ajay Jaiswal, Shiwei Liu, Ti…
  ☆11Updated last year
• ExplainableML / fomo_in_flux
  Code and benchmark for the paper: "A Practitioner's Guide to Continual Multimodal Pretraining" [NeurIPS'24]
  ☆60Updated 11 months ago
• VijayLingam95 / SVFT
  ☆33Updated 9 months ago
• VITA-Group / Lifelong-Learning-LTH
  [ICLR 2021] "Long Live the Lottery: The Existence of Winning Tickets in Lifelong Learning" by Tianlong Chen*, Zhenyu Zhang*, Sijia Liu, S…
  ☆25Updated 3 years ago
• BatsResearch / ex2
  If CLIP Could Talk: Understanding Vision-Language Model Representations Through Their Preferred Concept Descriptions
  ☆17Updated last year
• arazd / ResidualPrompts
  Residual Prompt Tuning: a method for faster and better prompt tuning.
  ☆56Updated 2 years ago
• VITA-Group / Robust_Weight_Signatures
  [ICML 2023] "Robust Weight Signatures: Gaining Robustness as Easy as Patching Weights?" by Ruisi Cai, Zhenyu Zhang, Zhangyang Wang
  ☆16Updated 2 years ago
• mshukor / eP-ALM
  [ICCV23] Official implementation of eP-ALM: Efficient Perceptual Augmentation of Language Models.
  ☆27Updated 2 years ago
• VITA-Group / PrAC-LTH
  [ICML 2021] "Efficient Lottery Ticket Finding: Less Data is More" by Zhenyu Zhang*, Xuxi Chen*, Tianlong Chen*, Zhangyang Wang
  ☆25Updated 3 years ago
• song-wx / SIFT
  [ICML2024 Spotlight] Fine-Tuning Pre-trained Large Language Models Sparsely
  ☆22Updated last year
• rgeirhos / dataset-pruning-metrics
  Metrics for "Beyond neural scaling laws: beating power law scaling via data pruning " (NeurIPS 2022 Outstanding Paper Award)
  ☆57Updated 2 years ago
• JeanKaddour / LAWA
  Latest Weight Averaging (NeurIPS HITY 2022)
  ☆31Updated 2 years ago
• mlfoundations / clip_quality_not_quantity
  ☆29Updated 3 years ago
• swaggy-TN / EfficientVLM
  EfficientVLM: Fast and Accurate Vision-Language Models via Knowledge Distillation and Modal-adaptive Pruning (ACL 2023)
  ☆32Updated 2 years ago
• VITA-Group / Diverse-ViT
  [CVPR 2022] "The Principle of Diversity: Training Stronger Vision Transformers Calls for Reducing All Levels of Redundancy" by Tianlong C…
  ☆25Updated 3 years ago
• bwconrad / soft-moe
  PyTorch implementation of "From Sparse to Soft Mixtures of Experts"
  ☆66Updated 2 years ago
• salesforce / ensemble-of-averages
  ☆31Updated 6 months ago
• ylsung / vl-merging
  PyTorch codes for the paper "An Empirical Study of Multimodal Model Merging"
  ☆37Updated 2 years ago
• EnnengYang / RepresentationSurgery
  Representation Surgery for Multi-Task Model Merging. ICML, 2024.
  ☆46Updated last year
• brendel-group / clip-ood
  Official code for the paper "Does CLIP's Generalization Performance Mainly Stem from High Train-Test Similarity?" (ICLR 2024)
  ☆10Updated last year
• facebookresearch / ModelRatatouille
  Recycling diverse models
  ☆46Updated 2 years ago