JarvisUSTC / Awesome-Multimodal-RAGLinks
A curated list of the latest advancements, papers, tools, and datasets for **Multimodal Retrieval-Augmented Generation (RAG)**. Multimodal RAG integrates information retrieval and generation across multiple data modalities (e.g., text, image, video, audio).
☆25Updated 6 months ago
Alternatives and similar repositories for Awesome-Multimodal-RAG
Users that are interested in Awesome-Multimodal-RAG are comparing it to the libraries listed below
Sorting:
- Official Repo for FoodieQA paper (EMNLP 2024)☆16Updated last month
- [ACL'25] Mosaic-IT: Cost-Free Compositional Data Synthesis for Instruction Tuning☆19Updated last month
- X-Reasoner: Towards Generalizable Reasoning Across Modalities and Domains☆47Updated 3 months ago
- [NeurIPS 2024] A Novel Rank-Based Metric for Evaluating Large Language Models☆51Updated 2 months ago
- Official Implementation for EMNLP 2024 (main) "AgentReview: Exploring Academic Peer Review with LLM Agent."☆83Updated 9 months ago
- SFT or RL? An Early Investigation into Training R1-Like Reasoning Large Vision-Language Models☆132Updated 3 months ago
- ☆67Updated last month
- Using image captions with LLM for zero-shot VQA☆18Updated last year
- This is the code of MMOA-RAG.☆67Updated 3 months ago
- An Easy-to-use Hallucination Detection Framework for LLMs.☆60Updated last year
- Code for our Paper "All in an Aggregated Image for In-Image Learning"☆29Updated last year
- [CVPR2025] VDocRAG: Retirval-Augmented Generation over Visually-Rich Documents☆33Updated 2 months ago
- The official repository for the Scientific Paper Idea Proposer (SciPIP)☆62Updated 5 months ago
- OpenRFT: Adapting Reasoning Foundation Model for Domain-specific Tasks with Reinforcement Fine-Tuning☆147Updated 7 months ago
- Unsupervised GRPO☆41Updated 2 months ago
- A curated list of awesome LLM Inference-Time Self-Improvement (ITSI, pronounced "itsy") papers from our recent survey: A Survey on Large …☆88Updated 7 months ago
- An benchmark for evaluating the capabilities of large vision-language models (LVLMs)☆46Updated last year
- [ICLR 2025] Mitigating Modality Prior-Induced Hallucinations in Multimodal Large Language Models via Deciphering Attention Causality☆36Updated last month
- Implementation and evaluation of multimodal RAG with text and image inputs for industrial applications☆60Updated 9 months ago
- survery of small language models☆15Updated last year
- ☆31Updated last year
- 超简单复现Deepseek-R1-Zero和Deepseek-R1，以「24点游戏」为例。通过zero-RL、SFT以及SFT+RL，以激发LLM的自主验证反思能力。 About Clean, minimal, accessible reproduction of Dee…☆24Updated 4 months ago
- ☆50Updated 5 months ago
- [NeurIPS 2024] For paper Parameter Competition Balancing for Model Merging☆45Updated 10 months ago
- This repository contains the code for SFT, RLHF, and DPO, designed for vision-based LLMs, including the LLaVA models and the LLaMA-3.2-vi…☆110Updated last month
- The codebase and some introductions of FineMed.☆24Updated last week
- [ACL'25] We propose a novel fine-tuning method, Separate Memory and Reasoning, which combines prompt tuning with LoRA.☆70Updated 3 weeks ago
- Offical Repository of "AtomThink: Multimodal Slow Thinking with Atomic Step Reasoning"☆54Updated last week
- MokA: Multimodal Low-Rank Adaptation for MLLMs☆21Updated last month
- RewardAnything: Generalizable Principle-Following Reward Models☆29Updated 2 months ago