MozerWang / promISe
[COLING 2024 Oral] promISe:Releasing the Capabilities of LLMs with Prompt Introspective Search
☆17Updated 3 weeks ago
Related projects: ⓘ
- DEEM: Official implementation of Diffusion models serve as the eyes of large language models for image perception.☆14Updated last month
- Official repo for "AlignGPT: Multi-modal Large Language Models with Adaptive Alignment Capability"☆29Updated 2 months ago
- 😎 up-to-date & curated list of awesome LMM hallucinations papers, methods & resources.☆140Updated 5 months ago
- The reinforcement learning codes for dataset SPA-VL☆15Updated 2 months ago
- ☆32Updated last month
- Papers about Hallucination in Multi-Modal Large Language Models (MLLMs)☆43Updated 3 weeks ago
- [CVPR 2024 Highlight] Mitigating Object Hallucinations in Large Vision-Language Models through Visual Contrastive Decoding☆177Updated 2 months ago
- ECSO (Make MLLM safe without neither training nor any external models!) (https://arxiv.org/abs/2403.09572)☆9Updated 4 months ago
- [ICML 2024] Official implementation for "HALC: Object Hallucination Reduction via Adaptive Focal-Contrast Decoding"☆63Updated 4 months ago
- HallE-Control: Controlling Object Hallucination in LMMs☆24Updated 5 months ago
- Official implementation of "LOOK-M: Look-Once Optimization in KV Cache for Efficient Multimodal Long-Context Inference"☆61Updated 2 months ago
- MoCLE (First MLLM with MoE for instruction customization and generalization!) (https://arxiv.org/abs/2312.12379)☆28Updated 5 months ago
- code for "Strengthening Multimodal Large Language Model with Bootstrapped Preference Optimization"☆40Updated 3 weeks ago
- A RLHF Infrastructure for Vision-Language Models☆86Updated 3 months ago
- HalluciDoctor: Mitigating Hallucinatory Toxicity in Visual Instruction Data (Accepted by CVPR 2024)☆39Updated 2 months ago
- Less is More: Mitigating Multimodal Hallucination from an EOS Decision Perspective (ACL 2024)☆25Updated last month
- Reading notes about Multimodal Large Language Models, Large Language Models, and Diffusion Models☆76Updated 2 weeks ago
- Code for ACL 2024 accepted paper titled "SAPT: A Shared Attention Framework for Parameter-Efficient Continual Learning of Large Language …☆19Updated last month
- ☆21Updated 2 months ago
- MMICL, a state-of-the-art VLM with the in context learning ability from ICL, PKU☆37Updated 11 months ago
- A Survey on Interpretable Cross-modal Reasoning☆13Updated 11 months ago
- The official PyTorch implementation of EchoSight: Advancing Visual-Language Models with Wiki Knowledge.☆18Updated last month
- [CVPR 2024 Highlight] OPERA: Alleviating Hallucination in Multi-Modal Large Language Models via Over-Trust Penalty and Retrospection-Allo…☆255Updated 3 weeks ago
- This is the first released survey paper on hallucinations of large vision-language models (LVLMs). To keep track of this field and contin…☆32Updated last month
- ☆23Updated 7 months ago
- An LLM-free Multi-dimensional Benchmark for Multi-modal Hallucination Evaluation☆85Updated 8 months ago
- mPLUG-HalOwl: Multimodal Hallucination Evaluation and Mitigating☆75Updated 7 months ago
- ☆20Updated last month
- The official GitHub page for ''Evaluating Object Hallucination in Large Vision-Language Models''☆166Updated 5 months ago
- MultiMath: Bridging Visual and Mathematical Reasoning for Large Language Models☆10Updated 2 weeks ago