vincentlux / Awesome-Multimodal-LLM
Reading list for Multimodal Large Language Models
☆68Updated last year
Alternatives and similar repositories for Awesome-Multimodal-LLM:
Users that are interested in Awesome-Multimodal-LLM are comparing it to the libraries listed below
- Official code for paper "UniIR: Training and Benchmarking Universal Multimodal Information Retrievers" (ECCV 2024)☆126Updated 4 months ago
- ☆59Updated last year
- MultiInstruct: Improving Multi-Modal Zero-Shot Learning via Instruction Tuning☆135Updated last year
- Beyond Hallucinations: Enhancing LVLMs through Hallucination-Aware Direct Preference Optimization☆81Updated last year
- Recent advancements propelled by large language models (LLMs), encompassing an array of domains including Vision, Audio, Agent, Robotics,…☆117Updated this week
- An Easy-to-use Hallucination Detection Framework for LLMs.☆57Updated 10 months ago
- 😎 curated list of awesome LMM hallucinations papers, methods & resources.☆147Updated 10 months ago
- Official Code of IdealGPT☆34Updated last year
- [NeurIPS 2024] CharXiv: Charting Gaps in Realistic Chart Understanding in Multimodal LLMs☆96Updated last month
- A Survey on Benchmarks of Multimodal Large Language Models☆87Updated last month
- Collection of papers and repos for multimodal chain-of-thought☆54Updated 3 months ago
- MLLM-Bench: Evaluating Multimodal LLMs with Per-sample Criteria☆63Updated 4 months ago
- ☆89Updated last year
- MATH-Vision dataset and code to measure Multimodal Mathematical Reasoning capabilities.☆86Updated 4 months ago
- ☆28Updated 3 months ago
- InstructionGPT-4☆39Updated last year
- [EMNLP 2024] mDPO: Conditional Preference Optimization for Multimodal Large Language Models.☆63Updated 3 months ago
- The official GitHub page for ''Evaluating Object Hallucination in Large Vision-Language Models''☆197Updated 10 months ago
- ☆61Updated 8 months ago
- mPLUG-HalOwl: Multimodal Hallucination Evaluation and Mitigating☆89Updated last year
- ☆94Updated last year
- [CVPR 2024] Official Code for the Paper "Compositional Chain-of-Thought Prompting for Large Multimodal Models"☆106Updated 8 months ago
- [Arxiv] Aligning Modalities in Vision Large Language Models via Preference Fine-tuning☆79Updated 9 months ago
- up-to-date curated list of state-of-the-art Large vision language models hallucinations research work, papers & resources☆92Updated 3 weeks ago
- [EMNLP'23] The official GitHub page for ''Evaluating Object Hallucination in Large Vision-Language Models''☆78Updated 10 months ago
- Less is More: Mitigating Multimodal Hallucination from an EOS Decision Perspective (ACL 2024)☆42Updated 3 months ago
- Touchstone: Evaluating Vision-Language Models by Language Models☆82Updated last year
- An LLM-free Multi-dimensional Benchmark for Multi-modal Hallucination Evaluation☆111Updated last year
- Enhancing Large Vision Language Models with Self-Training on Image Comprehension.☆63Updated 8 months ago
- ☆47Updated last year