roymiles / VeLoRALinks
[NeurIPS 2024] VeLoRA : Memory Efficient Training using Rank-1 Sub-Token Projections
☆21Updated last year
Alternatives and similar repositories for VeLoRA
Users that are interested in VeLoRA are comparing it to the libraries listed below
Sorting:
- Metrics for "Beyond neural scaling laws: beating power law scaling via data pruning " (NeurIPS 2022 Outstanding Paper Award)☆57Updated 2 years ago
- Model Merging with SVD to Tie the KnOTS [ICLR 2025]☆85Updated 10 months ago
- Towards Meta-Pruning via Optimal Transport, ICLR 2024 (Spotlight)☆18Updated last year
- Code for T-MARS data filtering☆35Updated 2 years ago
- [NeurIPS'24] Multilinear Mixture of Experts: Scalable Expert Specialization through Factorization☆39Updated last year
- Code for NOLA, an implementation of "nola: Compressing LoRA using Linear Combination of Random Basis"☆57Updated last year
- This is a PyTorch implementation of the paperViP A Differentially Private Foundation Model for Computer Vision☆36Updated 2 years ago
- [NeurIPS'24] Official PyTorch implementation for paper "Knowledge Composition using Task Vectors with Learned Anisotropic Scaling"☆27Updated 11 months ago
- ☆21Updated 3 years ago
- Code and benchmark for the paper: "A Practitioner's Guide to Continual Multimodal Pretraining" [NeurIPS'24]☆61Updated last year
- SLTrain: a sparse plus low-rank approach for parameter and memory efficient pretraining (NeurIPS 2024)☆39Updated last year
- ☆38Updated 2 years ago
- Official Code for NeurIPS 2022 Paper: How Mask Matters: Towards Theoretical Understandings of Masked Autoencoders☆69Updated 2 years ago
- Code release for "Understanding Bias in Large-Scale Visual Datasets"☆22Updated last year
- Switch EMA: A Free Lunch for Better Flatness and Sharpness☆28Updated last year
- ☆35Updated last year
- ☆46Updated last year
- Data distillation benchmark☆72Updated 7 months ago
- official code repo for paper "Merging Models on the Fly Without Retraining: A Sequential Approach to Scalable Continual Model Merging"☆22Updated 4 months ago
- Official code for "pi-Tuning: Transferring Multimodal Foundation Models with Optimal Multi-task Interpolation", ICML 2023.☆33Updated 2 years ago
- Original code base for On Pretraining Data Diversity for Self-Supervised Learning☆14Updated last year
- Official Pytorch Implementation of Our Paper Accepted at ICLR 2024-- Dynamic Sparse No Training: Training-Free Fine-tuning for Sparse LLM…☆50Updated last year
- Unofficial Implementation of Selective Attention Transformer☆20Updated last year
- Implementation for <Orthogonal Over-Parameterized Training> in CVPR'21.☆22Updated 4 years ago
- Official implementation of AAAI 2023 paper "Parameter-efficient Model Adaptation for Vision Transformers"☆106Updated 2 years ago
- Official implementation of the paper: "A deeper look at depth pruning of LLMs"☆15Updated last year
- [NeurIPS '25] Multi-Token Prediction Needs Registers☆26Updated last month
- ☆25Updated 2 years ago
- Official Code for Dataset Distillation using Neural Feature Regression (NeurIPS 2022)☆48Updated 3 years ago
- Code for paper "Parameter Efficient Multi-task Model Fusion with Partial Linearization"☆25Updated last year