Alternatives and similar repositories for VeLoRA

Users that are interested in VeLoRA are comparing it to the libraries listed below

• gstoica27 / KnOTS
  Model Merging with SVD to Tie the KnOTS [ICLR 2025]
  ☆70Updated 6 months ago
• UCDvision / NOLA
  Code for NOLA, an implementation of "nola: Compressing LoRA using Linear Combination of Random Basis"
  ☆56Updated last year
• facebookresearch / ViP-MAE
  This is a PyTorch implementation of the paperViP A Differentially Private Foundation Model for Computer Vision
  ☆36Updated 2 years ago
• andyjm3 / SLTrain
  SLTrain: a sparse plus low-rank approach for parameter and memory efficient pretraining (NeurIPS 2024)
  ☆35Updated last year
• Westlake-AI / SEMA
  Switch EMA: A Free Lunch for Better Flatness and Sharpness
  ☆27Updated last year
• alexandertheus / Intra-Fusion
  Towards Meta-Pruning via Optimal Transport, ICLR 2024 (Spotlight)
  ☆16Updated 10 months ago
• ExplainableML / fomo_in_flux
  Code and benchmark for the paper: "A Practitioner's Guide to Continual Multimodal Pretraining" [NeurIPS'24]
  ☆59Updated 10 months ago
• locuslab / T-MARS
  Code for T-MARS data filtering
  ☆35Updated 2 years ago
• wjxts / RegularizedBN
  ☆21Updated 2 years ago
• ggjy / vision_weak_to_strong
  ☆37Updated last year
• wy1iu / OPT
  Implementation for <Orthogonal Over-Parameterized Training> in CVPR'21.
  ☆22Updated 4 years ago
• ethanlshen / HierNet
  Code for "Are “Hierarchical” Visual Representations Hierarchical?" in NeurIPS Workshop for Symmetry and Geometry in Neural Representation…
  ☆21Updated last year
• james-oldfield / muMoE
  [NeurIPS'24] Multilinear Mixture of Experts: Scalable Expert Specialization through Factorization
  ☆35Updated last year
• rgeirhos / dataset-pruning-metrics
  Metrics for "Beyond neural scaling laws: beating power law scaling via data pruning " (NeurIPS 2022 Outstanding Paper Award)
  ☆57Updated 2 years ago
• pixeli99 / MixLN
  [ICLR 2025] Official Pytorch Implementation of "Mix-LN: Unleashing the Power of Deeper Layers by Combining Pre-LN and Post-LN" by Pengxia…
  ☆26Updated 3 months ago
• locuslab / llava-token-compression
  ☆44Updated 11 months ago
• fengyuli-dev / distribution-normalization
  Test-Time Distribution Normalization For Contrastively Learned Vision-language Models
  ☆27Updated last year
• zju-vipa / training_free_model_merging
  This repository is the implementation of the paper Training Free Pretrained Model Merging (CVPR2024).
  ☆31Updated last year
• TianjinYellow / SPAM-Optimizer
  ☆34Updated 7 months ago
• VijayLingam95 / SVFT
  ☆33Updated 8 months ago
• deep-spin / adasplash
  AdaSplash: Adaptive Sparse Flash Attention (aka Flash Entmax Attention)
  ☆29Updated last month
• TomerRonen34 / mixed-resolution-vit
  ☆53Updated 2 years ago
• hammoudhasan / DiversitySSL
  Original code base for On Pretraining Data Diversity for Self-Supervised Learning
  ☆14Updated 10 months ago
• TencentARC / pi-Tuning
  Official code for "pi-Tuning: Transferring Multimodal Foundation Models with Optimal Multi-task Interpolation", ICML 2023.
  ☆33Updated 2 years ago
• VILA-Lab / GBLM-Pruner
  Are gradient information useful for pruning of LLMs?
  ☆47Updated 2 months ago
• tml-epfl / why-weight-decay
  Why Do We Need Weight Decay in Modern Deep Learning? [NeurIPS 2024]
  ☆68Updated last year
• NUS-HPC-AI-Lab / DD-Ranking
  Data distillation benchmark
  ☆68Updated 4 months ago
• GATECH-EIC / Linearized-LLM
  [ICML 2024] When Linear Attention Meets Autoregressive Decoding: Towards More Effective and Efficient Linearized Large Language Models
  ☆36Updated last year
• fredzzhang / atlas
  [NeurIPS'24] Official PyTorch implementation for paper "Knowledge Composition using Task Vectors with Learned Anisotropic Scaling"
  ☆25Updated 8 months ago
• tianyu139 / tangent-model-composition
  Code for Tangent Model Composition for Ensembling and Continual Fine-tuning (ICCV 2023) and Tangent Transformers for Composition, Privacy…
  ☆13Updated last year