This is for ACL 2025 Findings Paper: From Specific-MLLMs to Omni-MLLMs: A Survey on MLLMs Aligned with Multi-modalitiesModels
☆103Mar 22, 2026Updated 4 months ago
Alternatives and similar repositories for Awesome-Omni-MLLMs
Users that are interested in Awesome-Omni-MLLMs are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- EchoInk-R1: Exploring Audio-Visual Reasoning in Multimodal LLMs via Reinforcement Learning (🔥The Exploration of R1 for General Audio-Vis…☆78Jun 3, 2026Updated 2 months ago
- [NeurIPS 2025] Watch and Listen: Understanding Audio-Visual-Speech Moments with Multimodal LLM☆27Feb 10, 2026Updated 6 months ago
- This is the official repository of Daily-Omni: Towards Audio-Visual Reasoning with Temporal Alignment across Modalities☆47Jul 26, 2026Updated 2 weeks ago
- Official code repository of Shuffle-R1☆26Feb 23, 2026Updated 5 months ago
- [ICML2026] OmniSIFT: Modality-Asymmetric Token Compression for Efficient Omni-modal Large Language Models☆28May 21, 2026Updated 2 months ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- This repository provides valuable reference for researchers in the field of multimodality, please start your exploratory travel in RL-bas…☆1,439Aug 2, 2026Updated last week
- The Source Code for OmniVideoBench @ICLR 2026☆78Feb 12, 2026Updated 5 months ago
- Use 2 lines to empower absolute time awareness for Qwen2.5VL's MRoPE☆29Sep 20, 2025Updated 10 months ago
- ☆15Dec 19, 2025Updated 7 months ago
- ☆19Jul 22, 2025Updated last year
- [CVPR 2026] Thinking with Programming Vision: Towards a Unified View for Thinking with Images☆72Jan 23, 2026Updated 6 months ago
- [ECCV 2026] Video-Holmes: Can MLLM Think Like Holmes for Complex Video Reasoning?☆97Jul 13, 2025Updated last year
- [ICLR 2026] Data Pipeline, Models, and Benchmark for Omni-Captioner.☆145Apr 7, 2026Updated 4 months ago
- WorldSense: Evaluating Real-world Omnimodal Understanding for Multimodal LLMs☆51Jul 12, 2026Updated 3 weeks ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Multi-step reasoning MLLM☆25Mar 8, 2026Updated 5 months ago
- OmniVinci is an omni-modal LLM for joint understanding of vision, audio, and language.☆675Feb 26, 2026Updated 5 months ago
- A Multi-Agent Approach Integrating Socratic Guidance for Automated Prompt Optimization☆18Dec 15, 2025Updated 7 months ago
- [ICLR 2026] Official repo for "FrameThinker: Learning to Think with Long Videos via Multi-Turn Frame Spotlighting"☆50Oct 9, 2025Updated 10 months ago
- [ACM MM 2025] TimeChat-online: 80% Visual Tokens are Naturally Redundant in Streaming Videos☆133Jun 29, 2026Updated last month
- Awesome latest models, datasets and benchmarks on streaming/online video understanding.☆31Oct 19, 2025Updated 9 months ago
- Data for evaluating GPT-4V☆11Oct 26, 2023Updated 2 years ago
- LVOmniBench: Pioneering Long Audio-Video Understanding Evaluation for Omnimodal LLMs☆41Apr 2, 2026Updated 4 months ago
- [CVPR 2026] OmniZip: Audio-Guided Dynamic Token Compression for Fast Omnimodal Large Language Models☆102Apr 20, 2026Updated 3 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- [ICCV2023] PyTorch implementation of ''Spatial-Aware Token for Weakly Supervised Object Localization''.☆23Oct 24, 2023Updated 2 years ago
- Reading notes about Multimodal Large Language Models, Large Language Models, and Diffusion Models☆1,189Jul 14, 2026Updated 3 weeks ago
- Latest Advances on (RL based) Multimodal Reasoning and Generation in Multimodal LLMs☆85Jul 26, 2026Updated 2 weeks ago
- [ECCV 26] Video Streaming Thinking☆122Jul 28, 2026Updated 2 weeks ago
- LongVALE: Vision-Audio-Language-Event Benchmark Towards Time-Aware Omni-Modal Perception of Long Videos. (CVPR 2025))☆61Jun 9, 2025Updated last year
- Benchmarking and Bridging Emotion Conflicts for Multimodal Emotion Reasoning (ACM MM 2025 Oral)☆39Oct 11, 2025Updated 10 months ago
- ☆194Feb 8, 2025Updated last year
- [ICLR'25] Official repository for "AVHBench: A Cross-Modal Hallucination Evaluation for Audio-Visual Large Language Models"☆26Mar 8, 2026Updated 5 months ago
- Awesome List for On-Policy Distillation☆817Jul 31, 2026Updated last week
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- 🔥An open-source survey of the latest video reasoning tasks, paradigms, and benchmarks.☆190Jun 14, 2026Updated last month
- ☆20Jul 21, 2025Updated last year
- Ke-Omni-R is an advanced audio reasoning model and achieved SOTA on MMAU☆61Jun 11, 2025Updated last year
- 📖 This is a repository for organizing papers, codes, and other resources related to unified multimodal models.☆365Jan 8, 2026Updated 7 months ago
- [ICLR26] ThinkOmni: Lifting Textual Reasoning to Omni-modal Scenarios via Guidance Decoding☆94Mar 20, 2026Updated 4 months ago
- A Comprehensive Survey on Evaluating Reasoning Capabilities in Multimodal Large Language Models.☆76Mar 18, 2025Updated last year
- ☆27Mar 5, 2026Updated 5 months ago