Alternatives and similar repositories for VeLoRA

Users that are interested in VeLoRA are comparing it to the libraries listed below

• gstoica27 / KnOTS
  Model Merging with SVD to Tie the KnOTS [ICLR 2025]
  ☆59Updated 3 months ago
• james-oldfield / muMoE
  [NeurIPS'24] Multilinear Mixture of Experts: Scalable Expert Specialization through Factorization
  ☆33Updated 9 months ago
• UCDvision / NOLA
  Code for NOLA, an implementation of "nola: Compressing LoRA using Linear Combination of Random Basis"
  ☆56Updated 10 months ago
• zju-vipa / training_free_model_merging
  This repository is the implementation of the paper Training Free Pretrained Model Merging (CVPR2024).
  ☆30Updated last year
• ExplainableML / fomo_in_flux
  Code and benchmark for the paper: "A Practitioner's Guide to Continual Multimodal Pretraining" [NeurIPS'24]
  ☆57Updated 7 months ago
• rgeirhos / dataset-pruning-metrics
  Metrics for "Beyond neural scaling laws: beating power law scaling via data pruning " (NeurIPS 2022 Outstanding Paper Award)
  ☆56Updated 2 years ago
• locuslab / T-MARS
  Code for T-MARS data filtering
  ☆35Updated last year
• facebookresearch / ViP-MAE
  This is a PyTorch implementation of the paperViP A Differentially Private Foundation Model for Computer Vision
  ☆36Updated 2 years ago
• tanganke / opcm
  ☆14Updated 5 months ago
• ggjy / vision_weak_to_strong
  ☆38Updated last year
• VijayLingam95 / SVFT
  ☆30Updated 5 months ago
• andyjm3 / SLTrain
  SLTrain: a sparse plus low-rank approach for parameter and memory efficient pretraining (NeurIPS 2024)
  ☆32Updated 8 months ago
• deep-spin / adasplash
  AdaSplash: Adaptive Sparse Flash Attention (aka Flash Entmax Attention)
  ☆15Updated this week
• PaulAlbert31 / RandLoRA
  ☆22Updated last month
• JngwenYe / LIRF
  Code for ECCV 2022 paper “Learning with Recoverable Forgetting”
  ☆21Updated 2 years ago
• zhangq327 / U-MAE
  Official Code for NeurIPS 2022 Paper: How Mask Matters: Towards Theoretical Understandings of Masked Autoencoders
  ☆67Updated last year
• boyazeng / understand_bias
  Code release for "Understanding Bias in Large-Scale Visual Datasets"
  ☆20Updated 7 months ago
• yu-rp / Distribution-Shift-Iverson
  ☆42Updated last year
• Westlake-AI / SEMA
  Switch EMA: A Free Lunch for Better Flatness and Sharpness
  ☆26Updated last year
• TomerRonen34 / mixed-resolution-vit
  ☆51Updated last year
• NUS-HPC-AI-Lab / DD-Ranking
  Data distillation benchmark
  ☆66Updated last month
• OpenGVLab / LLMPrune-BESA
  BESA is a differentiable weight pruning technique for large language models.
  ☆17Updated last year
• pixeli99 / MixLN
  [ICLR 2025] Official Pytorch Implementation of "Mix-LN: Unleashing the Power of Deeper Layers by Combining Pre-LN and Post-LN" by Pengxia…
  ☆25Updated 6 months ago
• AngusDujw / FTD-distillation
  The code of the paper "Minimizing the Accumulated Trajectory Error to Improve Dataset Distillation" (CVPR2023)
  ☆39Updated 2 years ago
• wjxts / RegularizedBN
  ☆21Updated 2 years ago
• alexandertheus / Intra-Fusion
  Towards Meta-Pruning via Optimal Transport, ICLR 2024 (Spotlight)
  ☆16Updated 7 months ago
• MohammadrezaBanaei / LoRA-XS
  LoRA-XS: Low-Rank Adaptation with Extremely Small Number of Parameters
  ☆35Updated 4 months ago
• mrflogs / LoRA-Pro
  Official code for our paper, "LoRA-Pro: Are Low-Rank Adapters Properly Optimized? "
  ☆126Updated 3 months ago
• eric-ai-lab / PEViT
  Official implementation of AAAI 2023 paper "Parameter-efficient Model Adaptation for Vision Transformers"
  ☆104Updated last year
• sail-sg / Attention-Sink
  [ICLR 2025] When Attention Sink Emerges in Language Models: An Empirical View (Spotlight)
  ☆99Updated last week