A curated list of the latest advancements, papers, tools, and datasets for **Multimodal Retrieval-Augmented Generation (RAG)**. Multimodal RAG integrates information retrieval and generation across multiple data modalities (e.g., text, image, video, audio).
☆53Nov 25, 2025Updated 8 months ago
Alternatives and similar repositories for Awesome-Multimodal-RAG
Users that are interested in Awesome-Multimodal-RAG are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- [CVPR2025] VDocRAG: Retirval-Augmented Generation over Visually-Rich Documents☆66May 26, 2025Updated last year
- Official Repo for paper "VLCache: Computing 2% Vision Tokens and Reusing 98% for Vision-Language Inference"☆15Mar 28, 2026Updated 4 months ago
- CatRAG is a RAG framework builds on the HippoRAG 2 architecture and transforms the static KG into query-adaptive navigation structure. RA…☆27Apr 14, 2026Updated 3 months ago
- CMD: a framework for Context-aware Model self-Detoxification (EMNLP2024 Long Paper)☆17Feb 10, 2025Updated last year
- [ACL 2025 (Findings)] DEMO: Reframing Dialogue Interaction with Fine-grained Element Modeling☆22Dec 16, 2024Updated last year
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- ☆24Nov 25, 2024Updated last year
- Overview and entry point for methods and experiment environments from paper "Stronger Baselines for Retrieval-Augmented Generation with L…☆25Nov 8, 2025Updated 9 months ago
- Copy as an OS Service☆27Nov 20, 2025Updated 8 months ago
- Dataset and scripts for HRDoc☆42Jun 21, 2023Updated 3 years ago
- Official PyTorch implementation of the TMI paper "Nucleus-aware Self-supervised Pretraining Using Unpaired Image-to-image Translation for…☆16Mar 13, 2024Updated 2 years ago
- Accelerating GOT-OCRv2 with VLLM☆10Nov 15, 2024Updated last year
- ☆43Apr 6, 2026Updated 4 months ago
- ☆26Aug 24, 2022Updated 3 years ago
- ☆13May 16, 2025Updated last year
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Official code for the ICLR 2025 paper, "Ada-K Routing: Boosting the Efficiency of MoE-based LLMs"☆12Mar 1, 2025Updated last year
- A comprehensive framework to explore whether embodied multimodal models are plausibly resilient☆12Nov 19, 2025Updated 8 months ago
- ☆16Mar 9, 2026Updated 5 months ago
- Implementation and evaluation of multimodal RAG with text and image inputs for industrial applications☆72Nov 6, 2024Updated last year
- Highly Efficient Query Rewriter for Passage Retrieval in the realm of Retrieval-Augmented Generation (RAG)☆30May 6, 2025Updated last year
- Official Implementation of Semantic Distribution-aware Contrastive Adaptation for Semantic Segmentation https://arxiv.org/abs/2105.05013☆38Apr 27, 2022Updated 4 years ago
- [ACM MM2025] Official code of " HM-RAG: Hierarchical Multi-Agent Multimodal Retrieval Augmented Generation"☆111Jul 23, 2025Updated last year
- [SIGIR'25 Short] Official Repository of "KGMEL: Knowledge Graph-Enhanced Multimodal Entity Linking"☆29Dec 17, 2025Updated 7 months ago
- [ICDAR 2024] (Best Student Paper🏆) Exploring Knowledge Distillation Towards Document Object Detection with Structured Graph Creation☆14Sep 6, 2024Updated last year
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- Learning Ontologies Via Embeddings☆12Jul 6, 2023Updated 3 years ago
- Scene Parsing via Integrated Classification Model and Variance-Based Regularization (Matlab&Caffe), In CVPR 2019☆12Jun 11, 2019Updated 7 years ago
- This is the official repository for Retrieval Augmented Visual Question Answering☆252Dec 19, 2024Updated last year
- Contrastive self-supervised learning using Rényi divergence☆14Oct 21, 2022Updated 3 years ago
- ☆10Oct 29, 2020Updated 5 years ago
- Official repository for the paper "Reconstruction of Perceived Images from fMRI Patterns and Semantic Brain Exploration using Instance-Co…☆24May 19, 2022Updated 4 years ago
- ☆12Jan 10, 2025Updated last year
- ☆12Jun 21, 2020Updated 6 years ago
- Reference implementation of the HEAT algorithm described in https://link.springer.com/chapter/10.1007/978-3-030-62362-3_4☆11Mar 24, 2023Updated 3 years ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- Exploring Robustness of Unsupervised Domain Adaptation in Semantic Segmentation (ICCV 2021; Oral)☆12Oct 9, 2022Updated 3 years ago
- Experiment with Neural ODE on Pytorch☆14Aug 9, 2019Updated 7 years ago
- Codes for our ICLR2020 paper: Knowledge Consistency between Neural Networks and Beyond☆16Jan 11, 2020Updated 6 years ago
- The code used to train and run inference with the ColQwen3 model. Welcome to follow and star! ⭐️⭐️⭐️ https://huggingface.co/goodman2001/…☆15Jul 4, 2026Updated last month
- Code for "Neural Network-based Reconstruction in Compressed Sensing MRI Without Fully-sampled Training Data"☆12Jan 5, 2021Updated 5 years ago
- unofficial impelement of the webformer: The Web-page Transformer for Structure Information Extraction☆13Apr 20, 2023Updated 3 years ago
- ☆14Nov 13, 2025Updated 8 months ago