Alternatives and similar repositories for VeLoRA

Users that are interested in VeLoRA are comparing it to the libraries listed below

• gstoica27 / KnOTS
  Model Merging with SVD to Tie the KnOTS [ICLR 2025]
  ☆80Updated 8 months ago
• james-oldfield / muMoE
  [NeurIPS'24] Multilinear Mixture of Experts: Scalable Expert Specialization through Factorization
  ☆37Updated last year
• UCDvision / NOLA
  Code for NOLA, an implementation of "nola: Compressing LoRA using Linear Combination of Random Basis"
  ☆57Updated last year
• zju-vipa / training_free_model_merging
  This repository is the implementation of the paper Training Free Pretrained Model Merging (CVPR2024).
  ☆32Updated last year
• andyjm3 / SLTrain
  SLTrain: a sparse plus low-rank approach for parameter and memory efficient pretraining (NeurIPS 2024)
  ☆38Updated last year
• facebookresearch / ViP-MAE
  This is a PyTorch implementation of the paperViP A Differentially Private Foundation Model for Computer Vision
  ☆36Updated 2 years ago
• locuslab / T-MARS
  Code for T-MARS data filtering
  ☆35Updated 2 years ago
• ExplainableML / fomo_in_flux
  Code and benchmark for the paper: "A Practitioner's Guide to Continual Multimodal Pretraining" [NeurIPS'24]
  ☆60Updated last year
• alexandertheus / Intra-Fusion
  Towards Meta-Pruning via Optimal Transport, ICLR 2024 (Spotlight)
  ☆16Updated last year
• rgeirhos / dataset-pruning-metrics
  Metrics for "Beyond neural scaling laws: beating power law scaling via data pruning " (NeurIPS 2022 Outstanding Paper Award)
  ☆57Updated 2 years ago
• wjxts / RegularizedBN
  ☆21Updated 2 years ago
• VijayLingam95 / SVFT
  ☆34Updated 10 months ago
• Westlake-AI / SEMA
  Switch EMA: A Free Lunch for Better Flatness and Sharpness
  ☆28Updated last year
• wy1iu / OPT
  Implementation for <Orthogonal Over-Parameterized Training> in CVPR'21.
  ☆22Updated 4 years ago
• fredzzhang / atlas
  [NeurIPS'24] Official PyTorch implementation for paper "Knowledge Composition using Task Vectors with Learned Anisotropic Scaling"
  ☆26Updated 9 months ago
• ggjy / vision_weak_to_strong
  ☆38Updated last year
• deep-spin / adasplash
  AdaSplash: Adaptive Sparse Flash Attention (aka Flash Entmax Attention)
  ☆30Updated 2 months ago
• tanganke / opcm
  official code repo for paper "Merging Models on the Fly Without Retraining: A Sequential Approach to Scalable Continual Model Merging"
  ☆22Updated 2 months ago
• TencentARC / pi-Tuning
  Official code for "pi-Tuning: Transferring Multimodal Foundation Models with Optimal Multi-task Interpolation", ICML 2023.
  ☆33Updated 2 years ago
• tsb0601 / MultiMon
  ☆25Updated 2 years ago
• shoaibahmed / llm_depth_pruning
  Official implementation of the paper: "A deeper look at depth pruning of LLMs"
  ☆15Updated last year
• pixeli99 / MixLN
  [ICLR 2025] Official Pytorch Implementation of "Mix-LN: Unleashing the Power of Deeper Layers by Combining Pre-LN and Post-LN" by Pengxia…
  ☆27Updated 4 months ago
• hammoudhasan / DiversitySSL
  Original code base for On Pretraining Data Diversity for Self-Supervised Learning
  ☆14Updated 11 months ago
• OpenGVLab / LLMPrune-BESA
  BESA is a differentiable weight pruning technique for large language models.
  ☆17Updated last year
• nasosger / MuToR
  [NeurIPS '25] Multi-Token Prediction Needs Registers
  ☆25Updated last week
• NUS-HPC-AI-Lab / DD-Ranking
  Data distillation benchmark
  ☆71Updated 6 months ago
• ldery / Bonsai
  Code for "Everybody Prune Now: Structured Pruning of LLMs with only Forward Passes"
  ☆29Updated last year
• zhangq327 / U-MAE
  Official Code for NeurIPS 2022 Paper: How Mask Matters: Towards Theoretical Understandings of Masked Autoencoders
  ☆68Updated 2 years ago
• boyazeng / understand_bias
  Code release for "Understanding Bias in Large-Scale Visual Datasets"
  ☆22Updated last year
• alhojel / visual_task_vectors
  ☆40Updated last year