Latest Advances on (RL based) Multimodal Reasoning and Generation in Multimodal LLMs
☆105Oct 15, 2026Updated this week
Alternatives and similar repositories for Awesome-Multimodal-Reasoning
Users that are interested in Awesome-Multimodal-Reasoning are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Official Repository for NeurIPS'25 Paper "Tool-Augmented Spatiotemporal Reasoning for Streamlining Video Question Answering Task"☆23Sep 4, 2026Updated last month
- This repository provides valuable reference for researchers in the field of multimodality, please start your exploratory travel in RL-bas…☆1,445Sep 29, 2026Updated 2 weeks ago
- ✨First Open-Source R1-like Video-LLM [2025/02/18]☆384Oct 10, 2026Updated last week
- [ACM MM 2025] ViTCoT: Video-Text Interleaved Chain-of-Thought for Boosting Video Understanding in Large Language Models☆19Jul 15, 2025Updated last year
- 🔥An open-source survey of the latest video reasoning tasks, paradigms, and benchmarks.☆193Sep 29, 2026Updated 2 weeks ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- [ICLR 2025] Mitigating Modality Prior-Induced Hallucinations in Multimodal Large Language Models via Deciphering Attention Causality☆67Jul 5, 2025Updated last year
- Latest open-source "Thinking with images" (O3/O4-mini) papers, covering training-free, SFT-based, and RL-enhanced methods for "fine-grain…☆114Aug 21, 2025Updated last year
- A collection of the latest research and resources on Fine-Grained Multimodal Perception☆34Jun 4, 2026Updated 4 months ago
- MM-EUREKA: Exploring the Frontiers of Multimodal Reasoning with Rule-based Reinforcement Learning☆770Sep 7, 2025Updated last year
- R1-like Video-LLM for Temporal Grounding☆137Jun 20, 2025Updated last year
- Explore VLM-Eval, a framework for evaluating Video Large Language Models, enhancing your video analysis with cutting-edge AI technology.☆37Jan 20, 2024Updated 2 years ago
- Multi-step reasoning MLLM☆26Mar 8, 2026Updated 7 months ago
- Official repository of "TDSD: Text-Driven Scene-Decoupled Weakly Supervised Video Anomaly Detection"☆11May 25, 2025Updated last year
- ☆21May 19, 2025Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Latest Advances on Modality Priors in Multimodal Large Language Models☆31Dec 10, 2025Updated 10 months ago
- Video-R1: Reinforcing Video Reasoning in MLLMs [🔥the first paper to explore R1 for video]☆895Dec 14, 2025Updated 10 months ago
- Implementation of ICCV 2025 paper "Growing a Twig to Accelerate Large Vision-Language Models".☆32May 23, 2026Updated 4 months ago
- VideoNIAH: A Flexible Synthetic Method for Benchmarking Video MLLMs☆57Mar 9, 2025Updated last year
- This is for ACL 2025 Findings Paper: From Specific-MLLMs to Omni-MLLMs: A Survey on MLLMs Aligned with Multi-modalitiesModels☆104Updated this week
- Extend OpenRLHF to support LMM RL training for reproduction of DeepSeek-R1 on multimodal tasks.☆847May 14, 2025Updated last year
- Reinforcement Learning Tuning for VideoLLMs: Reward Design and Data Efficiency☆62Jun 6, 2025Updated last year
- ☆111Sep 11, 2025Updated last year
- ☆22May 12, 2024Updated 2 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Collected the world's best computer vision labs and lecture materials.☆15Feb 23, 2025Updated last year
- [ICML 2026] HiDe: Rethinking The Zoom-IN method in High Resolution MLLMs via Hierarchical Decoupling☆32May 2, 2026Updated 5 months ago
- Towards Efficient and Effective Text-to-Video Retrieval with Coarse-to-Fine Visual Representation Learning☆21Feb 19, 2025Updated last year
- ☆11Apr 28, 2026Updated 5 months ago
- Vision-OPD is a regional-to-global on-policy self-distillation framework that transfers a model's own privileged crop-conditioned percept…☆337Sep 27, 2026Updated 3 weeks ago
- Awesome papers & datasets specifically focused on long-term videos.☆387Oct 9, 2025Updated last year
- Multimodal Chain-of-Thought Reasoning: A Comprehensive Survey☆1,028Oct 3, 2026Updated 2 weeks ago
- ☆16Nov 19, 2021Updated 4 years ago
- Perceive-to-Reason: Decoupling Perception and Reasoning for Fine-Grained Visual Reasoning☆35Jul 8, 2026Updated 3 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- [ICCV 2023] Simple Baselines for Interactive Video Retrieval with Questions and Answers☆20Apr 16, 2024Updated 2 years ago
- [NeurIPS 2026] Beyond SFT-to-RL: Pre-alignment via Black-BoxOn-Policy Distillation for Multimodal RL☆101May 6, 2026Updated 5 months ago
- Official code of *Towards Event-oriented Long Video Understanding*☆12Jul 26, 2024Updated 2 years ago
- Implementation for paper:"Learning Global-Local Correspondence with Semantic Bottleneck for Logical Anomaly Detection"☆14Aug 13, 2023Updated 3 years ago
- [TMLR 2026] Survey: https://arxiv.org/pdf/2507.20198☆402Jul 27, 2026Updated 2 months ago
- A fork to add multimodal model training to open-r1☆1,605Feb 8, 2025Updated last year
- 大模型应用与开发实验教程☆19Jul 2, 2026Updated 3 months ago