roymiles / VeLoRALinks
[NeurIPS 2024] VeLoRA : Memory Efficient Training using Rank-1 Sub-Token Projections
☆20Updated 8 months ago
Alternatives and similar repositories for VeLoRA
Users that are interested in VeLoRA are comparing it to the libraries listed below
Sorting:
- Metrics for "Beyond neural scaling laws: beating power law scaling via data pruning " (NeurIPS 2022 Outstanding Paper Award)☆56Updated 2 years ago
- [NeurIPS'24] Multilinear Mixture of Experts: Scalable Expert Specialization through Factorization☆32Updated 8 months ago
- Towards Meta-Pruning via Optimal Transport, ICLR 2024 (Spotlight)☆16Updated 6 months ago
- ☆21Updated 2 weeks ago
- Model Merging with SVD to Tie the KnOTS [ICLR 2025]☆57Updated 2 months ago
- Official implementation of "Parameter-Efficient Orthogonal Finetuning via Butterfly Factorization"☆77Updated last year
- SLTrain: a sparse plus low-rank approach for parameter and memory efficient pretraining (NeurIPS 2024)☆31Updated 7 months ago
- This repository is the implementation of the paper Training Free Pretrained Model Merging (CVPR2024).☆30Updated last year
- Code for NOLA, an implementation of "nola: Compressing LoRA using Linear Combination of Random Basis"☆56Updated 10 months ago
- BESA is a differentiable weight pruning technique for large language models.☆17Updated last year
- ☆42Updated 7 months ago
- [ICLR 2024] Improving Convergence and Generalization Using Parameter Symmetries☆29Updated last year
- Code release for "Understanding Bias in Large-Scale Visual Datasets"☆20Updated 6 months ago
- Official code for "pi-Tuning: Transferring Multimodal Foundation Models with Optimal Multi-task Interpolation", ICML 2023.☆33Updated last year
- [NeurIPS 2024] AlphaPruning: Using Heavy-Tailed Self Regularization Theory for Improved Layer-wise Pruning of Large Language Models☆24Updated 2 weeks ago
- ☆13Updated 4 months ago
- LoRA-XS: Low-Rank Adaptation with Extremely Small Number of Parameters☆35Updated 3 months ago
- LCA-on-the-line (ICML 2024 Oral)☆12Updated 4 months ago
- Code for CVPR 2024 Oral "Neural Lineage"☆17Updated last year
- Code for ECCV 2022 paper “Learning with Recoverable Forgetting”☆21Updated 2 years ago
- ☆21Updated 2 years ago
- [ECCV’24] Official repository for "BEAF: Observing Before-AFter Changes to Evaluate Hallucination in Vision-language Models"☆20Updated 3 months ago
- Code for T-MARS data filtering☆35Updated last year
- Official Pytorch Implementation of Our Paper Accepted at ICLR 2024-- Dynamic Sparse No Training: Training-Free Fine-tuning for Sparse LLM…☆47Updated last year
- Switch EMA: A Free Lunch for Better Flatness and Sharpness☆26Updated last year
- Code for paper "Parameter Efficient Multi-task Model Fusion with Partial Linearization"☆21Updated 9 months ago
- ☆42Updated last year
- This is a PyTorch implementation of the paperViP A Differentially Private Foundation Model for Computer Vision☆36Updated last year
- [CVPR 2024] Friendly Sharpness-Aware Minimization☆33Updated 7 months ago
- Data distillation benchmark☆66Updated last week