vincentlux / Awesome-Multimodal-LLM
Reading list for Multimodal Large Language Models
☆68Updated last year
Alternatives and similar repositories for Awesome-Multimodal-LLM:
Users that are interested in Awesome-Multimodal-LLM are comparing it to the libraries listed below
- MultiInstruct: Improving Multi-Modal Zero-Shot Learning via Instruction Tuning☆136Updated last year
- MLLM-Bench: Evaluating Multimodal LLMs with Per-sample Criteria☆66Updated 5 months ago
- ☆61Updated last year
- Official code for paper "UniIR: Training and Benchmarking Universal Multimodal Information Retrievers" (ECCV 2024)☆137Updated 5 months ago
- Beyond Hallucinations: Enhancing LVLMs through Hallucination-Aware Direct Preference Optimization☆85Updated last year
- mPLUG-HalOwl: Multimodal Hallucination Evaluation and Mitigating☆92Updated last year
- 😎 curated list of awesome LMM hallucinations papers, methods & resources.☆150Updated last year
- Enhancing Large Vision Language Models with Self-Training on Image Comprehension.☆65Updated 9 months ago
- [Arxiv] Aligning Modalities in Vision Large Language Models via Preference Fine-tuning☆81Updated 10 months ago
- 🦩 Visual Instruction Tuning with Polite Flamingo - training multi-modal LLMs to be both clever and polite! (AAAI-24 Oral)☆64Updated last year
- The official GitHub page for ''Evaluating Object Hallucination in Large Vision-Language Models''☆199Updated last year
- [ECCV 2024] Paying More Attention to Image: A Training-Free Method for Alleviating Hallucination in LVLMs☆109Updated 4 months ago
- ☆143Updated 4 months ago
- [EMNLP 2024] mDPO: Conditional Preference Optimization for Multimodal Large Language Models.☆69Updated 4 months ago
- Touchstone: Evaluating Vision-Language Models by Language Models☆82Updated last year
- A RLHF Infrastructure for Vision-Language Models☆167Updated 4 months ago
- ☆70Updated 2 months ago
- up-to-date curated list of state-of-the-art Large vision language models hallucinations research work, papers & resources☆107Updated last month
- [ICLR 2024] Analyzing and Mitigating Object Hallucination in Large Vision-Language Models☆145Updated 10 months ago
- [ICLR 2023] This is the code repo for our ICLR‘23 paper "Universal Vision-Language Dense Retrieval: Learning A Unified Representation Spa…☆50Updated 8 months ago
- Code for Math-LLaVA: Bootstrapping Mathematical Reasoning for Multimodal Large Language Models☆81Updated 9 months ago
- ☆91Updated last year
- SVIT: Scaling up Visual Instruction Tuning☆163Updated 9 months ago
- [EMNLP'23] The official GitHub page for ''Evaluating Object Hallucination in Large Vision-Language Models''☆82Updated last year
- [NeurIPS 2024] CharXiv: Charting Gaps in Realistic Chart Understanding in Multimodal LLMs☆99Updated 3 months ago
- VideoHallucer, The first comprehensive benchmark for hallucination detection in large video-language models (LVLMs)☆27Updated 9 months ago
- Sparkles: Unlocking Chats Across Multiple Images for Multimodal Instruction-Following Models☆43Updated 9 months ago
- ☆49Updated last year
- Official repository for the A-OKVQA dataset☆79Updated 10 months ago
- An Easy-to-use Hallucination Detection Framework for LLMs.☆58Updated 11 months ago