leo-yangli / VB-LoRA
This repo contains the source code for VB-LoRA: Extreme Parameter Efficient Fine-Tuning with Vector Banks.
☆12Updated 3 months ago
Related projects: ⓘ
- GIFT: Generative Interpretable Fine-Tuning☆17Updated 2 months ago
- [ACL 2023] PuMer: Pruning and Merging Tokens for Efficient Vision Language Models☆25Updated last year
- The official implementation for MTLoRA: A Low-Rank Adaptation Approach for Efficient Multi-Task Learning☆25Updated last month
- ☆54Updated 2 months ago
- Adapting LLaMA Decoder to Vision Transformer☆25Updated 4 months ago
- ☆16Updated this week
- Official code for ICLR 2024 paper Do Generated Data Always Help Contrastive Learning?☆25Updated 5 months ago
- The codebase for our paper: Multimodal Self-Instruct: Synthetic Abstract Image and Visual Reasoning Instruction Using Language Model☆37Updated last month
- PyTorch implementation of StableMask (ICML'24)☆11Updated 2 months ago
- ☆16Updated last month
- Official Repository of Multi-Object Hallucination in Vision-Language Models☆19Updated last month
- ☆20Updated last month
- code for ACL24 "MELoRA: Mini-Ensemble Low-Rank Adapter for Parameter-Efficient Fine-Tuning"☆12Updated 4 months ago
- ☆40Updated 5 months ago
- ☆20Updated 4 months ago
- Syphus: Automatic Instruction-Response Generation Pipeline☆14Updated 9 months ago
- ☆8Updated 5 months ago
- [ICML 2024] SPP: Sparsity-Preserved Parameter-Efficient Fine-Tuning for Large Language Models☆13Updated 3 months ago
- [ICLR 2024 Spotlight] Code for the paper "Merge, Then Compress: Demystify Efficient SMoE with Hints from Its Routing Policy"☆63Updated 3 months ago
- ☆27Updated last month
- Official code for "pi-Tuning: Transferring Multimodal Foundation Models with Optimal Multi-task Interpolation", ICML 2023.☆32Updated last year
- Repo for the paper `ControlMLLM: Training-Free Visual Prompt Learning for Multimodal Large Language Models'☆44Updated 3 weeks ago
- Making LLaVA Tiny via MoE-Knowledge Distillation☆21Updated 3 weeks ago
- Enhancing Large Vision Language Models with Self-Training on Image Comprehension.☆51Updated 3 months ago
- ☆13Updated 2 months ago
- Code for ECCV 2022 paper “Learning with Recoverable Forgetting”☆21Updated 2 years ago
- Official code for our paper, "LoRA-Pro: Are Low-Rank Adapters Properly Optimized? "☆49Updated last month
- Implementation of the paper: "Mixture-of-Depths: Dynamically allocating compute in transformer-based language models"☆56Updated this week
- Code for https://arxiv.org/abs/2401.17139☆12Updated 5 months ago
- [ICML'24 Oral] APT: Adaptive Pruning and Tuning Pretrained Language Models for Efficient Training and Inference☆21Updated 3 months ago