This is for ACL 2025 Findings Paper: From Specific-MLLMs to Omni-MLLMs: A Survey on MLLMs Aligned with Multi-modalitiesModels
☆104Oct 13, 2026Updated 2 weeks ago
Alternatives and similar repositories for Awesome-Omni-MLLMs
Users that are interested in Awesome-Omni-MLLMs are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- EchoInk-R1: Exploring Audio-Visual Reasoning in Multimodal LLMs via Reinforcement Learning (🔥The Exploration of R1 for General Audio-Vis…☆80Jun 3, 2026Updated 4 months ago
- [NeurIPS 2025] Watch and Listen: Understanding Audio-Visual-Speech Moments with Multimodal LLM☆27Aug 27, 2026Updated 2 months ago
- OmniPro: A Comprehensive Benchmark for Omni-Proactive Streaming Video Understanding☆19Jul 27, 2026Updated 3 months ago
- Official code repository of Shuffle-R1☆26Feb 23, 2026Updated 8 months ago
- This is the official repository of Daily-Omni: Towards Audio-Visual Reasoning with Temporal Alignment across Modalities☆52Updated this week
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- OmniInteract: Benchmarking Real-World Streaming Interaction for Real-Time Omnimodal Assistants☆24May 30, 2026Updated 5 months ago
- This repository provides valuable reference for researchers in the field of multimodality, please start your exploratory travel in RL-bas…☆1,445Sep 29, 2026Updated last month
- ☆15May 19, 2026Updated 5 months ago
- The Source Code for OmniVideoBench @ICLR 2026☆80Feb 12, 2026Updated 8 months ago
- ☆18Jul 22, 2025Updated last year
- [ICML2026] OmniSIFT: Modality-Asymmetric Token Compression for Efficient Omni-modal Large Language Models☆32May 21, 2026Updated 5 months ago
- ☆17Dec 19, 2025Updated 10 months ago
- Use 2 lines to empower absolute time awareness for Qwen2.5VL's MRoPE☆28Sep 20, 2025Updated last year
- A benchmark for evaluating future-event forecasting from audio and video context in multimodal language models☆30Jan 22, 2026Updated 9 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- [CVPR 2026] Thinking with Programming Vision: Towards a Unified View for Thinking with Images☆75Jan 23, 2026Updated 9 months ago
- [ICLR 2026] Data Pipeline, Models, and Benchmark for Omni-Captioner.☆147Apr 7, 2026Updated 6 months ago
- [ECCV 2026] Video-Holmes: Can MLLM Think Like Holmes for Complex Video Reasoning?☆101Jul 13, 2025Updated last year
- ChronusOmni: Improving Time Awareness of Omni Large Language Models☆13Jan 18, 2026Updated 9 months ago
- Agentic MLLMs☆216Oct 24, 2025Updated last year
- A Comprehensive Survey on Evaluating Reasoning Capabilities in Multimodal Large Language Models.☆76Mar 18, 2025Updated last year
- 🔥An open-source survey of the latest video reasoning tasks, paradigms, and benchmarks.☆194Sep 29, 2026Updated last month
- WorldSense: Evaluating Real-world Omnimodal Understanding for Multimodal LLMs☆51Jul 12, 2026Updated 3 months ago
- ☆13Dec 13, 2024Updated last year
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- ☆27Jul 5, 2026Updated 3 months ago
- [ECCV’24] Official Implementation for CAT: Enhancing Multimodal Large Language Model to Answer Questions in Dynamic Audio-Visual Scenario…☆59Sep 4, 2024Updated 2 years ago
- A Multi-Agent Approach Integrating Socratic Guidance for Automated Prompt Optimization☆18Dec 15, 2025Updated 10 months ago
- ☆10Jun 9, 2025Updated last year
- OmniVinci is an omni-modal LLM for joint understanding of vision, audio, and language.☆685Aug 31, 2026Updated 2 months ago
- Multi-step reasoning MLLM☆26Mar 8, 2026Updated 7 months ago
- Awesome latest models, datasets and benchmarks on streaming/online video understanding.☆32Oct 19, 2025Updated last year
- [ICLR26] ThinkOmni: Lifting Textual Reasoning to Omni-modal Scenarios via Guidance Decoding☆87Mar 20, 2026Updated 7 months ago
- LVOmniBench: Pioneering Long Audio-Video Understanding Evaluation for Omnimodal LLMs☆42Oct 3, 2026Updated 3 weeks ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- [CVPR 2026] See, Hear, and Understand: Benchmarking Audiovisual Human Speech Understanding in Multimodal Large Language Models☆12Apr 6, 2026Updated 6 months ago
- [ACM MM 2025] TimeChat-online: 80% Visual Tokens are Naturally Redundant in Streaming Videos☆135Jun 29, 2026Updated 4 months ago
- [ICLR 2026] Official repo for "FrameThinker: Learning to Think with Long Videos via Multi-Turn Frame Spotlighting"☆56Oct 9, 2025Updated last year
- Ola: Pushing the Frontiers of Omni-Modal Language Model☆395Jun 13, 2025Updated last year
- [ICCV2023] PyTorch implementation of ''Spatial-Aware Token for Weakly Supervised Object Localization''.☆23Oct 24, 2023Updated 3 years ago
- ☆29Nov 14, 2025Updated 11 months ago
- [CVPR 2026] OmniZip: Audio-Guided Dynamic Token Compression for Fast Omnimodal Large Language Models☆109Apr 20, 2026Updated 6 months ago