VT-NLP / MixLoRA
Multimodal Instruction Tuning with Conditional Mixture of LoRA (ACL 2024)
☆15Updated 7 months ago
Alternatives and similar repositories for MixLoRA:
Users that are interested in MixLoRA are comparing it to the libraries listed below
- MoCLE (First MLLM with MoE for instruction customization and generalization!) (https://arxiv.org/abs/2312.12379)☆34Updated 11 months ago
- code for ACL24 "MELoRA: Mini-Ensemble Low-Rank Adapter for Parameter-Efficient Fine-Tuning"☆19Updated last month
- ☆131Updated 8 months ago
- [EMNLP 2024] mDPO: Conditional Preference Optimization for Multimodal Large Language Models.☆69Updated 4 months ago
- Code for Reducing Hallucinations in Vision-Language Models via Latent Space Steering☆36Updated 4 months ago
- ☆64Updated 9 months ago
- Awesome Low-Rank Adaptation☆34Updated 6 months ago
- ☆45Updated 4 months ago
- Code for ACL 2024 accepted paper titled "SAPT: A Shared Attention Framework for Parameter-Efficient Continual Learning of Large Language …☆33Updated 2 months ago
- ☆11Updated 4 months ago
- Official Code and data for ACL 2024 finding, "An Empirical Study on Parameter-Efficient Fine-Tuning for MultiModal Large Language Models"☆16Updated 4 months ago
- [ICLR 2024] This is the repository for the paper titled "DePT: Decomposed Prompt Tuning for Parameter-Efficient Fine-tuning"☆96Updated 11 months ago
- [NeurIPS 2024 Spotlight] EMR-Merging: Tuning-Free High-Performance Model Merging☆52Updated 3 weeks ago
- [EMNLP 2023 Main] Sparse Low-rank Adaptation of Pre-trained Language Models☆72Updated last year
- ☆27Updated 11 months ago
- ☆71Updated this week
- CLIP-MoE: Mixture of Experts for CLIP☆29Updated 5 months ago
- CHAIR metric is a rule-based metric for evaluating object hallucination in caption generation.☆27Updated last year
- Awesome-Low-Rank-Adaptation☆87Updated 5 months ago
- This is the official repo for Debiasing Large Visual Language Models, including a Post-Hoc debias method and Visual Debias Decoding strat…☆77Updated last month
- [SIGIR'24] The official implementation code of MOELoRA.☆154Updated 8 months ago
- [ACL 2024] The official codebase for the paper "Self-Distillation Bridges Distribution Gap in Language Model Fine-tuning".☆116Updated 4 months ago
- AdaMoLE: Adaptive Mixture of LoRA Experts☆23Updated 5 months ago
- ☆23Updated 9 months ago
- Official implementation of "MMNeuron: Discovering Neuron-Level Domain-Specific Interpretation in Multimodal Large Language Model". Our co…☆17Updated 3 months ago
- [NeurIPS'24 Oral] HydraLoRA: An Asymmetric LoRA Architecture for Efficient Fine-Tuning☆177Updated 3 months ago
- Instruction Tuning in Continual Learning paradigm☆44Updated last month
- [ICLR 2025] The official pytorch implement of "Dynamic-LLaVA: Efficient Multimodal Large Language Models via Dynamic Vision-language Cont…☆26Updated 3 months ago
- This repository contains the code for SFT, RLHF, and DPO, designed for vision-based LLMs, including the LLaVA models and the LLaMA-3.2-vi…☆104Updated 5 months ago
- [SIGIR'24] The official implementation code of MOELoRA.☆30Updated 7 months ago