lhanchao777 / LVLM-Hallucinations-Survey
This is the first released survey paper on hallucinations of large vision-language models (LVLMs). To keep track of this field and continuously update our survey, we maintain this repository of relevant references.
β60Updated 6 months ago
Alternatives and similar repositories for LVLM-Hallucinations-Survey:
Users that are interested in LVLM-Hallucinations-Survey are comparing it to the libraries listed below
- [ICML 2024] Official implementation for "HALC: Object Hallucination Reduction via Adaptive Focal-Contrast Decoding"β80Updated 2 months ago
- π curated list of awesome LMM hallucinations papers, methods & resources.β147Updated 10 months ago
- up-to-date curated list of state-of-the-art Large vision language models hallucinations research work, papers & resourcesβ92Updated 3 weeks ago
- mPLUG-HalOwl: Multimodal Hallucination Evaluation and Mitigatingβ89Updated last year
- The official GitHub page for ''Evaluating Object Hallucination in Large Vision-Language Models''β197Updated 10 months ago
- [CVPR 2024 Highlight] Mitigating Object Hallucinations in Large Vision-Language Models through Visual Contrastive Decodingβ238Updated 4 months ago
- HallE-Control: Controlling Object Hallucination in LMMsβ29Updated 10 months ago
- [ICLR 2024] Analyzing and Mitigating Object Hallucination in Large Vision-Language Modelsβ141Updated 9 months ago
- Papers about Hallucination in Multi-Modal Large Language Models (MLLMs)β79Updated 3 months ago
- [ECCV 2024] Paying More Attention to Image: A Training-Free Method for Alleviating Hallucination in LVLMsβ98Updated 3 months ago
- Less is More: Mitigating Multimodal Hallucination from an EOS Decision Perspective (ACL 2024)β42Updated 3 months ago
- MMICL, a state-of-the-art VLM with the in context learning ability from ICL, PKUβ46Updated last year
- [EMNLP 2024 Findings] The official PyTorch implementation of EchoSight: Advancing Visual-Language Models with Wiki Knowledge.β53Updated last month
- This is the official repo for Debiasing Large Visual Language Models, including a Post-Hoc debias method and Visual Debias Decoding stratβ¦β76Updated 10 months ago
- Code for Reducing Hallucinations in Vision-Language Models via Latent Space Steeringβ27Updated 2 months ago
- Visualizing the attention of vision-language modelsβ109Updated 3 months ago
- [EMNLP'23] The official GitHub page for ''Evaluating Object Hallucination in Large Vision-Language Models''β78Updated 10 months ago
- This repository contains the code for SFT, RLHF, and DPO, designed for vision-based LLMs, including the LLaVA models and the LLaMA-3.2-viβ¦β100Updated 4 months ago
- β41Updated 2 months ago
- β103Updated last week
- [EMNLP 2024] mDPO: Conditional Preference Optimization for Multimodal Large Language Models.β63Updated 3 months ago
- Beyond Hallucinations: Enhancing LVLMs through Hallucination-Aware Direct Preference Optimizationβ81Updated last year
- CHAIR metric is a rule-based metric for evaluating object hallucination in caption generation.β26Updated last year
- β61Updated 8 months ago
- the official repo for EMNLP 2024 (main) paper "EFUF: Efficient Fine-grained Unlearning Framework for Mitigating Hallucinations in Multimoβ¦β17Updated 4 months ago
- PyTorch Implementation of "Divide, Conquer and Combine: A Training-Free Framework for High-Resolution Image Perception in Multimodal Largβ¦β20Updated 2 weeks ago
- Official implementation of paper 'Look Twice Before You Answer: Memory-Space Visual Retracing for Hallucination Mitigation in Multimodal β¦β39Updated last week
- [CVPR 2024] Retrieval-Augmented Image Captioning with External Visual-Name Memory for Open-World Comprehensionβ45Updated 10 months ago
- A RLHF Infrastructure for Vision-Language Modelsβ162Updated 3 months ago
- An LLM-free Multi-dimensional Benchmark for Multi-modal Hallucination Evaluationβ111Updated last year