Chongjie-Si / Subspace-Tuning
A generalized framework for subspace tuning methods in parameter efficient fine-tuning.
☆102Updated 2 months ago
Related projects ⓘ
Alternatives and complementary repositories for Subspace-Tuning
- ☆154Updated last month
- ☆76Updated 4 months ago
- [NeurIPS'24 Oral] HydraLoRA: An Asymmetric LoRA Architecture for Efficient Fine-Tuning☆74Updated this week
- Official code for our paper, "LoRA-Pro: Are Low-Rank Adapters Properly Optimized? "☆74Updated 3 weeks ago
- ☆131Updated 2 months ago
- ☆116Updated 3 months ago
- [EMNLP 2023 Main] Sparse Low-rank Adaptation of Pre-trained Language Models☆69Updated 8 months ago
- [EMNLP 2024 Findings🔥] Official implementation of "LOOK-M: Look-Once Optimization in KV Cache for Efficient Multimodal Long-Context Infe…☆75Updated last week
- ☆147Updated 4 months ago
- A curated list of awesome Multimodal studies.☆97Updated 2 weeks ago
- LoRAMoE: Revolutionizing Mixture of Experts for Maintaining World Knowledge in Language Model Alignment☆230Updated 6 months ago
- LLaVA-PruMerge: Adaptive Token Reduction for Efficient Large Multimodal Models☆100Updated 6 months ago
- ☆23Updated 3 months ago
- Making LLaVA Tiny via MoE-Knowledge Distillation☆60Updated 3 weeks ago
- A paper list of some recent works about Token Compress for Vit and VLM☆139Updated this week
- [SIGIR'24] The official implementation code of MOELoRA.☆124Updated 3 months ago
- Survey on Data-centric Large Language Models☆65Updated 4 months ago
- State-of-the-art Parameter-Efficient MoE Fine-tuning Method☆92Updated 2 months ago
- [ICML'24 Oral] APT: Adaptive Pruning and Tuning Pretrained Language Models for Efficient Training and Inference☆28Updated 5 months ago
- [ICLR 2024 Spotlight] Code for the paper "Merge, Then Compress: Demystify Efficient SMoE with Hints from Its Routing Policy"☆64Updated 5 months ago
- [NeurIPS'24] Official PyTorch Implementation of Seeing the Image: Prioritizing Visual Correlation by Contrastive Alignment☆50Updated last month
- Awesome-Low-Rank-Adaptation☆38Updated last month
- ☆14Updated 5 months ago
- ☆85Updated 10 months ago
- A RLHF Infrastructure for Vision-Language Models☆104Updated this week
- Official implementation of "DoRA: Weight-Decomposed Low-Rank Adaptation"☆123Updated 6 months ago
- ☆73Updated 8 months ago
- ☆58Updated 3 months ago
- code for ACL24 "MELoRA: Mini-Ensemble Low-Rank Adapter for Parameter-Efficient Fine-Tuning"☆15Updated 6 months ago