THUNLP-MT / ModelCompose
Official code for our paper "Model Composition for Multimodal Large Language Models" (ACL 2024)
☆22Updated last month
Alternatives and similar repositories for ModelCompose:
Users that are interested in ModelCompose are comparing it to the libraries listed below
- PyTorch Implementation of "Divide, Conquer and Combine: A Training-Free Framework for High-Resolution Image Perception in Multimodal Larg…☆20Updated 2 weeks ago
- Less is More: Mitigating Multimodal Hallucination from an EOS Decision Perspective (ACL 2024)☆42Updated 3 months ago
- mPLUG-HalOwl: Multimodal Hallucination Evaluation and Mitigating☆89Updated last year
- [EMNLP 2024] mDPO: Conditional Preference Optimization for Multimodal Large Language Models.☆63Updated 3 months ago
- ☆61Updated 8 months ago
- ☆94Updated last year
- ☆28Updated 3 months ago
- MMICL, a state-of-the-art VLM with the in context learning ability from ICL, PKU☆46Updated last year
- [ICML 2024] Official implementation for "HALC: Object Hallucination Reduction via Adaptive Focal-Contrast Decoding"☆80Updated 2 months ago
- This is the official repo for Debiasing Large Visual Language Models, including a Post-Hoc debias method and Visual Debias Decoding strat…☆76Updated 10 months ago
- HalluciDoctor: Mitigating Hallucinatory Toxicity in Visual Instruction Data (Accepted by CVPR 2024)☆43Updated 7 months ago
- [NeurIPS 2024] Calibrated Self-Rewarding Vision Language Models☆68Updated 8 months ago
- [ICCV2023] Official code for "VL-PET: Vision-and-Language Parameter-Efficient Tuning via Granularity Control"☆53Updated last year
- ☆64Updated 5 years ago
- MoCLE (First MLLM with MoE for instruction customization and generalization!) (https://arxiv.org/abs/2312.12379)☆33Updated 10 months ago
- Beyond Hallucinations: Enhancing LVLMs through Hallucination-Aware Direct Preference Optimization☆81Updated last year
- [ICLR 2024] Analyzing and Mitigating Object Hallucination in Large Vision-Language Models☆141Updated 9 months ago
- [EMNLP'23] The official GitHub page for ''Evaluating Object Hallucination in Large Vision-Language Models''☆78Updated 10 months ago
- Official implementation of paper 'Look Twice Before You Answer: Memory-Space Visual Retracing for Hallucination Mitigation in Multimodal …☆39Updated last week
- code for "Strengthening Multimodal Large Language Model with Bootstrapped Preference Optimization"☆54Updated 5 months ago
- ☆103Updated last week
- ☆138Updated 3 months ago
- [ICML2024] Repo for the paper `Evaluating and Analyzing Relationship Hallucinations in Large Vision-Language Models'☆20Updated last month
- The official GitHub page for ''Evaluating Object Hallucination in Large Vision-Language Models''☆197Updated 10 months ago
- M-HalDetect Dataset Release☆21Updated last year
- ☆39Updated last year
- ☆33Updated 7 months ago
- ☆29Updated 7 months ago
- [ICML 2024] Memory-Space Visual Prompting for Efficient Vision-Language Fine-Tuning☆45Updated 9 months ago
- CorDA: Context-Oriented Decomposition Adaptation of Large Language Models for task-aware parameter-efficient fine-tuning(NeurIPS 2024)☆42Updated last month