opendatalab / HA-DPO
Beyond Hallucinations: Enhancing LVLMs through Hallucination-Aware Direct Preference Optimization
☆81Updated last year
Alternatives and similar repositories for HA-DPO:
Users that are interested in HA-DPO are comparing it to the libraries listed below
- [EMNLP'23] The official GitHub page for ''Evaluating Object Hallucination in Large Vision-Language Models''☆78Updated 11 months ago
- The official GitHub page for ''Evaluating Object Hallucination in Large Vision-Language Models''☆198Updated 11 months ago
- [EMNLP 2024] mDPO: Conditional Preference Optimization for Multimodal Large Language Models.☆66Updated 3 months ago
- [ICLR 2024] Analyzing and Mitigating Object Hallucination in Large Vision-Language Models☆142Updated 10 months ago
- [NeurIPS 2024] Calibrated Self-Rewarding Vision Language Models☆68Updated 8 months ago
- ☆94Updated last year
- MMICL, a state-of-the-art VLM with the in context learning ability from ICL, PKU☆46Updated last year
- ☆139Updated 4 months ago
- This is the official repo for Debiasing Large Visual Language Models, including a Post-Hoc debias method and Visual Debias Decoding strat…☆76Updated last week
- Less is More: Mitigating Multimodal Hallucination from an EOS Decision Perspective (ACL 2024)☆42Updated 4 months ago
- ☆59Updated last year
- [Arxiv] Aligning Modalities in Vision Large Language Models via Preference Fine-tuning☆79Updated 10 months ago
- A RLHF Infrastructure for Vision-Language Models☆162Updated 3 months ago
- [CVPR 2024 Highlight] Mitigating Object Hallucinations in Large Vision-Language Models through Visual Contrastive Decoding☆242Updated 4 months ago
- Enhancing Large Vision Language Models with Self-Training on Image Comprehension.☆63Updated 9 months ago
- ☆50Updated 7 months ago
- HalluciDoctor: Mitigating Hallucinatory Toxicity in Visual Instruction Data (Accepted by CVPR 2024)☆43Updated 7 months ago
- [ICML2024] Repo for the paper `Evaluating and Analyzing Relationship Hallucinations in Large Vision-Language Models'☆20Updated 2 months ago
- A collection of visual instruction tuning datasets.☆76Updated 11 months ago
- [ICLR'24] Mitigating Hallucination in Large Multi-Modal Models via Robust Instruction Tuning☆271Updated 11 months ago
- An LLM-free Multi-dimensional Benchmark for Multi-modal Hallucination Evaluation☆111Updated last year
- ☆91Updated last year
- Official repository of MMDU dataset☆85Updated 5 months ago
- ☆65Updated last month
- ☆28Updated 3 months ago
- Repository of paper: Position-Enhanced Visual Instruction Tuning for Multimodal Large Language Models☆37Updated last year
- Official repository for the A-OKVQA dataset☆75Updated 9 months ago
- VoCoT: Unleashing Visually Grounded Multi-Step Reasoning in Large Multi-Modal Models☆47Updated 7 months ago
- up-to-date curated list of state-of-the-art Large vision language models hallucinations research work, papers & resources☆95Updated last week
- [NeurIPS 2024] Needle In A Multimodal Haystack (MM-NIAH): A comprehensive benchmark designed to systematically evaluate the capability of…☆112Updated 3 months ago