zchoi / Multi-Modal-Large-Language-Learning
Awesome multi-modal large language paper/project, collections of popular training strategies, e.g., PEFT, LoRA.
☆26Updated 5 months ago
Alternatives and similar repositories for Multi-Modal-Large-Language-Learning:
Users that are interested in Multi-Modal-Large-Language-Learning are comparing it to the libraries listed below
- ZoomEye: Enhancing Multimodal LLMs with Human-Like Zooming Capabilities through Tree-Based Image Exploration☆22Updated 3 weeks ago
- Official Pytorch implementation of "Interpreting and Editing Vision-Language Representations to Mitigate Hallucinations"☆53Updated this week
- [ICLR 2025] MLLM can see? Dynamic Correction Decoding for Hallucination Mitigation☆33Updated last month
- [EMNLP'23] The official GitHub page for ''Evaluating Object Hallucination in Large Vision-Language Models''☆77Updated 10 months ago
- Less is More: Mitigating Multimodal Hallucination from an EOS Decision Perspective (ACL 2024)☆41Updated 3 months ago
- up-to-date curated list of state-of-the-art Large vision language models hallucinations research work, papers & resources☆78Updated 3 weeks ago
- This is the official repo for Debiasing Large Visual Language Models, including a Post-Hoc debias method and Visual Debias Decoding strat…☆76Updated 10 months ago
- [EMNLP 2024] mDPO: Conditional Preference Optimization for Multimodal Large Language Models.☆59Updated 2 months ago
- A Survey on Benchmarks of Multimodal Large Language Models☆83Updated 3 weeks ago
- 🔥 Omni large models and datasets for understanding and generating multi-modalities.☆13Updated 3 months ago
- CLIP-MoE: Mixture of Experts for CLIP☆23Updated 3 months ago
- Official PyTorch Implementation of MLLM Is a Strong Reranker: Advancing Multimodal Retrieval-augmented Generation via Knowledge-enhanced …☆53Updated 2 months ago
- text-only training or language-free training for multimodal tasks (image/audio/video caption, retrieval, text2image)☆11Updated 3 months ago
- [NeurIPS'24] Official PyTorch Implementation of Seeing the Image: Prioritizing Visual Correlation by Contrastive Alignment☆56Updated 4 months ago
- An automatic MLLM hallucination detection framework☆19Updated last year
- [ICLR 2024] Analyzing and Mitigating Object Hallucination in Large Vision-Language Models☆141Updated 9 months ago
- [ECCV 2024] Paying More Attention to Image: A Training-Free Method for Alleviating Hallucination in LVLMs☆95Updated 2 months ago
- DEEM: Official implementation of Diffusion models serve as the eyes of large language models for image perception. (ICLR2025)☆18Updated last month
- [ICML 2024 Oral] Official code repository for MLLM-as-a-Judge.☆62Updated 2 months ago
- This is the first released survey paper on hallucinations of large vision-language models (LVLMs). To keep track of this field and contin…☆60Updated 6 months ago
- [NeurIPS 2024] Calibrated Self-Rewarding Vision Language Models☆62Updated 7 months ago
- Beyond Hallucinations: Enhancing LVLMs through Hallucination-Aware Direct Preference Optimization☆78Updated last year
- [Arxiv] Aligning Modalities in Vision Large Language Models via Preference Fine-tuning☆79Updated 9 months ago
- Enhancing Large Vision Language Models with Self-Training on Image Comprehension.☆62Updated 7 months ago
- The codebase for our EMNLP24 paper: Multimodal Self-Instruct: Synthetic Abstract Image and Visual Reasoning Instruction Using Language Mo…☆68Updated this week
- AutoHallusion Codebase (EMNLP 2024)☆17Updated last month
- [CVPR 2024] Official Code for the Paper "Compositional Chain-of-Thought Prompting for Large Multimodal Models"☆104Updated 7 months ago
- mPLUG-HalOwl: Multimodal Hallucination Evaluation and Mitigating☆88Updated last year
- 🔥🔥🔥Code for "Empowering Multimodal Large Language Models with Evol-Instruct"☆12Updated 2 months ago
- An benchmark for evaluating the capabilities of large vision-language models (LVLMs)☆43Updated last year