A curated list of the latest advancements, papers, tools, and datasets for **Multimodal Retrieval-Augmented Generation (RAG)**. Multimodal RAG integrates information retrieval and generation across multiple data modalities (e.g., text, image, video, audio).
☆55Sep 17, 2026Updated 3 weeks ago
Alternatives and similar repositories for Awesome-Multimodal-RAG
Users that are interested in Awesome-Multimodal-RAG are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆15May 30, 2025Updated last year
- [CVPR2025] VDocRAG: Retirval-Augmented Generation over Visually-Rich Documents☆67May 26, 2025Updated last year
- Official Repo for paper "VLCache: Computing 2% Vision Tokens and Reusing 98% for Vision-Language Inference"☆16Mar 28, 2026Updated 6 months ago
- This repository contains a Multimodal Retrieval-Augmented Generation (RAG) Pipeline that integrates images, audio, and text for advanced …☆27Jan 19, 2025Updated last year
- CatRAG is a RAG framework builds on the HippoRAG 2 architecture and transforms the static KG into query-adaptive navigation structure. RA…☆29Aug 20, 2026Updated last month
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- The code used to train and run inference with MMDocRAG☆21Nov 6, 2025Updated 11 months ago
- Official Implementation of LatentSwap3D: Semantic Edits on 3D Image GANs☆23Nov 28, 2023Updated 2 years ago
- Working note for WSI analysis☆10Apr 3, 2023Updated 3 years ago
- Accelerating GOT-OCRv2 with VLLM☆10Nov 15, 2024Updated last year
- ☆44Apr 6, 2026Updated 6 months ago
- ☆15May 16, 2025Updated last year
- A comprehensive framework to explore whether embodied multimodal models are plausibly resilient☆12Nov 19, 2025Updated 10 months ago
- [ACL 2025] Multi-Agent System for Science of Science☆70Jul 26, 2025Updated last year
- an R package to perform synchronization analysis on motion energy time-series☆17Jun 30, 2026Updated 3 months ago
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- Implementation and evaluation of multimodal RAG with text and image inputs for industrial applications☆72Nov 6, 2024Updated last year
- ☆13Apr 26, 2022Updated 4 years ago
- Official Implementation of Semantic Distribution-aware Contrastive Adaptation for Semantic Segmentation https://arxiv.org/abs/2105.05013☆38Apr 27, 2022Updated 4 years ago
- 在RAG技术中，嵌入向量的生成和匹配是关键环节。本文介绍了一种基于CLIP/BLIP模型的嵌入服务，该服务支持文本和图像的嵌入生成与相似度计算，为多模态信息检索提供了基础能力。☆42Dec 28, 2024Updated last year
- [ACM MM2025] Official code of " HM-RAG: Hierarchical Multi-Agent Multimodal Retrieval Augmented Generation"☆114Jul 23, 2025Updated last year
- Evaluation benchmark for the task of Semantic Image Translation. Contains code to run FlexIT (CVPR 2022)☆34Mar 25, 2022Updated 4 years ago
- Utility functions/scripts for working with GPUs.☆10Jul 5, 2021Updated 5 years ago
- [ACL 2025] Towards Text-Image Interleaved Retrieval☆16Sep 3, 2025Updated last year
- ☆12Feb 7, 2021Updated 5 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- [ACL 2024 Oral] This is the code repo for our ACL‘24 paper "MARVEL: Unlocking the Multi-Modal Capability of Dense Retrieval via Visual Mo…☆39Jun 30, 2024Updated 2 years ago
- Multimodal Retrieval-augmented Generation Framework Built by Tongyi Lab, Alibaba Group.☆988Apr 29, 2026Updated 5 months ago
- Scraping Dynamic Websites with Python and Selenium☆14Jun 22, 2022Updated 4 years ago
- [ICDAR 2024] (Best Student Paper🏆) Exploring Knowledge Distillation Towards Document Object Detection with Structured Graph Creation☆15Sep 6, 2024Updated 2 years ago
- Scene Parsing via Integrated Classification Model and Variance-Based Regularization (Matlab&Caffe), In CVPR 2019☆12Jun 11, 2019Updated 7 years ago
- Awesome-RAG-Vision: a curated list of advanced retrieval augmented generation (RAG) for Computer Vision☆341Jan 25, 2026Updated 8 months ago
- This is the official repository for Retrieval Augmented Visual Question Answering☆253Dec 19, 2024Updated last year
- Prompt Optimization with Human Feedback☆18Aug 7, 2024Updated 2 years ago
- paper-read-notes☆13Sep 26, 2024Updated 2 years ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Price Elasticities and Purchase Incidence Model☆14Apr 17, 2020Updated 6 years ago
- ☆12Jan 10, 2025Updated last year
- ☆12Jun 21, 2020Updated 6 years ago
- ☆30Mar 31, 2026Updated 6 months ago
- List of Papers in MRI Reconstruction☆28Sep 15, 2026Updated 3 weeks ago
- Experiment with Neural ODE on Pytorch☆14Aug 9, 2019Updated 7 years ago
- Code for NeurIPS 2019 paper "From voxels to pixels and back: Self-supervision in natural-image reconstruction from fMRI"☆43Apr 24, 2022Updated 4 years ago