TUDB-Labs / Awesome-LLM-LoRALinks
☆15Updated last year
Alternatives and similar repositories for Awesome-LLM-LoRA
Users that are interested in Awesome-LLM-LoRA are comparing it to the libraries listed below
Sorting:
- Awesome Low-Rank Adaptation☆39Updated 2 weeks ago
- The official implementation for MTLoRA: A Low-Rank Adaptation Approach for Efficient Multi-Task Learning (CVPR '24)☆53Updated 3 months ago
- [ICLR 2025] Dynamic Mixture of Experts: An Auto-Tuning Approach for Efficient Transformer Models☆110Updated 4 months ago
- Multimodal Instruction Tuning with Conditional Mixture of LoRA (ACL 2024)☆22Updated 10 months ago
- MoCLE (First MLLM with MoE for instruction customization and generalization!) (https://arxiv.org/abs/2312.12379)☆41Updated last year
- ICLR 2025☆26Updated last month
- The official PyTorch implementation of the paper "MLAE: Masked LoRA Experts for Visual Parameter-Efficient Fine-Tuning"☆28Updated 6 months ago
- Low-Rank Rescaled Vision Transformer Fine-Tuning: A Residual Design Approach, CVPR 2024☆22Updated 11 months ago
- ☆39Updated 11 months ago
- ☆105Updated 11 months ago
- Inference Code for Paper "Harder Tasks Need More Experts: Dynamic Routing in MoE Models"☆52Updated 10 months ago
- AdaMoLE: Adaptive Mixture of LoRA Experts☆32Updated 8 months ago
- [NeurIPS'24 Oral] HydraLoRA: An Asymmetric LoRA Architecture for Efficient Fine-Tuning☆214Updated 6 months ago
- [SIGIR'24] The official implementation code of MOELoRA.☆31Updated 10 months ago
- EMPO, A Fully Unsupervised RLVR Method☆40Updated 2 weeks ago
- a training-free approach to accelerate ViTs and VLMs by pruning redundant tokens based on similarity☆28Updated last month
- CLIP-MoE: Mixture of Experts for CLIP☆42Updated 8 months ago
- Official code for paper: Beyond Attention or Similarity: Maximizing Conditional Diversity for Token Pruning in MLLMs.☆31Updated this week
- A block pruning framework for LLMs.☆23Updated last month
- iLLaVA: An Image is Worth Fewer Than 1/3 Input Tokens in Large Multimodal Models☆19Updated 4 months ago
- code for ACL24 "MELoRA: Mini-Ensemble Low-Rank Adapter for Parameter-Efficient Fine-Tuning"☆19Updated 4 months ago
- ☆26Updated last year
- [ICLR 2025] The official pytorch implement of "Dynamic-LLaVA: Efficient Multimodal Large Language Models via Dynamic Vision-language Cont…☆42Updated 6 months ago
- [ICML'24 Oral] APT: Adaptive Pruning and Tuning Pretrained Language Models for Efficient Training and Inference☆39Updated last year
- An Efficient LLM Fine-Tuning Factory Optimized for MoE PEFT☆102Updated 3 months ago
- Multi-Stage Vision Token Dropping: Towards Efficient Multimodal Large Language Model☆30Updated 5 months ago
- Official Repo for SparseLLM: Global Pruning of LLMs (NeurIPS 2024)☆62Updated 3 months ago
- Efficient and Online Dataset Growth Algorithm (with cleanness and diversity awareness) to deal with growing web data☆20Updated 10 months ago
- ☆18Updated 8 months ago
- [NeurIPS2023] Parameter-efficient Tuning of Large-scale Multimodal Foundation Model☆88Updated last year