UCDvision / NOLALinks
Code for NOLA, an implementation of "nola: Compressing LoRA using Linear Combination of Random Basis"
☆57Updated last year
Alternatives and similar repositories for NOLA
Users that are interested in NOLA are comparing it to the libraries listed below
Sorting:
- Model Merging with SVD to Tie the KnOTS [ICLR 2025]☆80Updated 8 months ago
- Code and benchmark for the paper: "A Practitioner's Guide to Continual Multimodal Pretraining" [NeurIPS'24]☆61Updated last year
- Official PyTorch Implementation for Vision-Language Models Create Cross-Modal Task Representations, ICML 2025☆31Updated 7 months ago
- ☆53Updated 11 months ago
- ☆46Updated last year
- [NeurIPS 2024] VeLoRA : Memory Efficient Training using Rank-1 Sub-Token Projections☆21Updated last year
- [ACL 2023] PuMer: Pruning and Merging Tokens for Efficient Vision Language Models☆36Updated last year
- Code for experiments for "ConvNet vs Transformer, Supervised vs CLIP: Beyond ImageNet Accuracy"☆101Updated last year
- Official code for "TOAST: Transfer Learning via Attention Steering"☆188Updated 2 years ago
- Official repository for the paper "SwitchHead: Accelerating Transformers with Mixture-of-Experts Attention"☆102Updated last year
- [ACL2025] Unsolvable Problem Detection: Robust Understanding Evaluation for Large Multimodal Models☆79Updated 6 months ago
- This repository is the implementation of the paper Training Free Pretrained Model Merging (CVPR2024).☆32Updated last year
- Geometric-Mean Policy Optimization☆95Updated last month
- Evaluating Deep Multimodal Reasoning in Vision-Centric Agentic Tasks☆33Updated last month
- PyTorch implementation of "From Sparse to Soft Mixtures of Experts"☆67Updated 2 years ago
- Implementation of the paper: "Mixture-of-Depths: Dynamically allocating compute in transformer-based language models"☆111Updated 3 weeks ago
- [ICLR 2025] Official Pytorch Implementation of "Mix-LN: Unleashing the Power of Deeper Layers by Combining Pre-LN and Post-LN" by Pengxia…☆27Updated 5 months ago
- [NAACL 2025 Oral] Multimodal Needle in a Haystack (MMNeedle): Benchmarking Long-Context Capability of Multimodal Large Language Models☆54Updated 7 months ago
- HGRN2: Gated Linear RNNs with State Expansion☆56Updated last year
- PyTorch Implementation of Object Recognition as Next Token Prediction [CVPR'24 Highlight]☆181Updated 7 months ago
- ☆189Updated last year
- [ICML 2024] This repository includes the official implementation of our paper "Rejuvenating image-GPT as Strong Visual Representation Lea…☆98Updated last year
- This is a PyTorch implementation of the paperViP A Differentially Private Foundation Model for Computer Vision☆36Updated 2 years ago
- ☆40Updated last year
- EfficientVLM: Fast and Accurate Vision-Language Models via Knowledge Distillation and Modal-adaptive Pruning (ACL 2023)☆32Updated 2 years ago
- Distributed Optimization Infra for learning CLIP models☆27Updated last year
- [Technical Report] Official PyTorch implementation code for realizing the technical part of Phantom of Latent representing equipped with …☆62Updated last year
- More dimensions = More fun☆26Updated last year
- ☆38Updated last year
- Matryoshka Multimodal Models☆121Updated 11 months ago