A curated list of the latest advancements, papers, tools, and datasets for **Multimodal Retrieval-Augmented Generation (RAG)**. Multimodal RAG integrates information retrieval and generation across multiple data modalities (e.g., text, image, video, audio).
☆53Nov 25, 2025Updated 7 months ago
Alternatives and similar repositories for Awesome-Multimodal-RAG
Users that are interested in Awesome-Multimodal-RAG are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- [CVPR2025] VDocRAG: Retirval-Augmented Generation over Visually-Rich Documents☆66May 26, 2025Updated last year
- CMD: a framework for Context-aware Model self-Detoxification (EMNLP2024 Long Paper)☆17Feb 10, 2025Updated last year
- The code used to train and run inference with MMDocRAG☆21Nov 6, 2025Updated 8 months ago
- Copy as an OS Service☆27Nov 20, 2025Updated 8 months ago
- Dataset and scripts for HRDoc☆42Jun 21, 2023Updated 3 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Official PyTorch implementation of the TMI paper "Nucleus-aware Self-supervised Pretraining Using Unpaired Image-to-image Translation for…☆16Mar 13, 2024Updated 2 years ago
- ☆41Apr 6, 2026Updated 3 months ago
- Official code for the ICLR 2025 paper, "Ada-K Routing: Boosting the Efficiency of MoE-based LLMs"☆12Mar 1, 2025Updated last year
- ☆13May 16, 2025Updated last year
- Look Back to Reason Forward: Revisitable Memory for Long-Context LLM Agents☆42Apr 13, 2026Updated 3 months ago
- Implementation and evaluation of multimodal RAG with text and image inputs for industrial applications☆72Nov 6, 2024Updated last year
- Highly Efficient Query Rewriter for Passage Retrieval in the realm of Retrieval-Augmented Generation (RAG)☆30May 6, 2025Updated last year
- 此Line bot範例為使用 LineBotSDK 建立的 『圖片、人臉辨識 Bot』 用戶可以傳遞照片給 bot ，它會辨識出照 片的內容(圖說)，以及照片中的人、性別和、年紀....☆22Mar 5, 2019Updated 7 years ago
- Utility functions/scripts for working with GPUs.☆10Jul 5, 2021Updated 5 years ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- [ACL 2025] Towards Text-Image Interleaved Retrieval☆16Sep 3, 2025Updated 10 months ago
- ☆11Apr 8, 2023Updated 3 years ago
- [ICLR 2020] Haotao Wang, Tianlong Chen, Zhangyang Wang, Kede Ma, "I Am Going MAD: Maximum Discrepancy Competition for Comparing Classifie…☆20Dec 30, 2021Updated 4 years ago
- Python Camouflage Pattern Generator, GUI available☆26Apr 22, 2026Updated 2 months ago
- Multimodal Retrieval-augmented Generation Framework Built by Tongyi Lab, Alibaba Group.☆969Apr 29, 2026Updated 2 months ago
- This repository is intended to take down what I learn from a book named Python3网络爬虫开发实战（第2版）.☆11Mar 29, 2023Updated 3 years ago
- [ACL 2024 Oral] This is the code repo for our ACL‘24 paper "MARVEL: Unlocking the Multi-Modal Capability of Dense Retrieval via Visual Mo…☆39Jun 30, 2024Updated 2 years ago
- [ICDAR 2024] (Best Student Paper🏆) Exploring Knowledge Distillation Towards Document Object Detection with Structured Graph Creation☆16Sep 6, 2024Updated last year
- Scene Parsing via Integrated Classification Model and Variance-Based Regularization (Matlab&Caffe), In CVPR 2019☆12Jun 11, 2019Updated 7 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Awesome-RAG-Vision: a curated list of advanced retrieval augmented generation (RAG) for Computer Vision☆339Jan 25, 2026Updated 5 months ago
- This is the official repository for Retrieval Augmented Visual Question Answering☆251Dec 19, 2024Updated last year
- ☆18Oct 25, 2022Updated 3 years ago
- The Unreliability of Explanations in Few-shot Prompting for Textual Reasoning (NeurIPS 2022)☆16Feb 11, 2023Updated 3 years ago
- Contrastive self-supervised learning using Rényi divergence☆14Oct 21, 2022Updated 3 years ago
- LONGAGENT: Scaling Language Models to 128k Context through Multi-Agent Collaboration☆11Mar 11, 2024Updated 2 years ago
- paper-read-notes☆13Sep 26, 2024Updated last year
- ☆35Jan 27, 2026Updated 5 months ago
- ☆28Feb 7, 2024Updated 2 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- To mitigate position bias in LLMs, especially in long-context scenarios, we scale only one dimension of LLMs, reducing position bias and …☆12Jun 18, 2024Updated 2 years ago
- Reference implementation of the HEAT algorithm described in https://link.springer.com/chapter/10.1007/978-3-030-62362-3_4☆11Mar 24, 2023Updated 3 years ago
- ☆27Mar 31, 2026Updated 3 months ago
- Experiment with Neural ODE on Pytorch☆14Aug 9, 2019Updated 6 years ago
- Synchronizing Claude Code conversations across machines☆16Jul 3, 2026Updated 2 weeks ago
- Benchmark dataset for the paper "Towards Next-Generation Recommender Systems: A Benchmark for Personalized Recommendation Assistant with …☆28May 20, 2025Updated last year
- The code used to train and run inference with the ColQwen3 model. Welcome to follow and star! ⭐️⭐️⭐️ https://huggingface.co/goodman2001/…☆15Jul 4, 2026Updated 2 weeks ago