This is for ACL 2025 Findings Paper: From Specific-MLLMs to Omni-MLLMs: A Survey on MLLMs Aligned with Multi-modalitiesModels
☆103Mar 22, 2026Updated 5 months ago
Alternatives and similar repositories for Awesome-Omni-MLLMs
Users that are interested in Awesome-Omni-MLLMs are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- EchoInk-R1: Exploring Audio-Visual Reasoning in Multimodal LLMs via Reinforcement Learning (🔥The Exploration of R1 for General Audio-Vis…☆79Jun 3, 2026Updated 2 months ago
- [NeurIPS 2025] Watch and Listen: Understanding Audio-Visual-Speech Moments with Multimodal LLM☆27Updated this week
- This is the official repository of Daily-Omni: Towards Audio-Visual Reasoning with Temporal Alignment across Modalities☆47Jul 26, 2026Updated last month
- Official code repository of Shuffle-R1☆26Feb 23, 2026Updated 6 months ago
- [ICML2026] OmniSIFT: Modality-Asymmetric Token Compression for Efficient Omni-modal Large Language Models☆28May 21, 2026Updated 3 months ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- This repository provides valuable reference for researchers in the field of multimodality, please start your exploratory travel in RL-bas…☆1,441Aug 2, 2026Updated 3 weeks ago
- The Source Code for OmniVideoBench @ICLR 2026☆78Feb 12, 2026Updated 6 months ago
- Use 2 lines to empower absolute time awareness for Qwen2.5VL's MRoPE☆29Sep 20, 2025Updated 11 months ago
- ☆15Dec 19, 2025Updated 8 months ago
- ☆19Jul 22, 2025Updated last year
- [CVPR 2026] Thinking with Programming Vision: Towards a Unified View for Thinking with Images☆73Jan 23, 2026Updated 7 months ago
- [FCS'24] LVLM Safety paper☆19Jan 4, 2025Updated last year
- [ECCV 2026] Video-Holmes: Can MLLM Think Like Holmes for Complex Video Reasoning?☆98Jul 13, 2025Updated last year
- [ICLR 2026] Data Pipeline, Models, and Benchmark for Omni-Captioner.☆146Apr 7, 2026Updated 4 months ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- WorldSense: Evaluating Real-world Omnimodal Understanding for Multimodal LLMs☆51Jul 12, 2026Updated last month
- Multi-step reasoning MLLM☆25Mar 8, 2026Updated 5 months ago
- OmniVinci is an omni-modal LLM for joint understanding of vision, audio, and language.☆677Feb 26, 2026Updated 6 months ago
- A Multi-Agent Approach Integrating Socratic Guidance for Automated Prompt Optimization☆18Dec 15, 2025Updated 8 months ago
- [ICLR 2026] Official repo for "FrameThinker: Learning to Think with Long Videos via Multi-Turn Frame Spotlighting"☆56Oct 9, 2025Updated 10 months ago
- [ACM MM 2025] TimeChat-online: 80% Visual Tokens are Naturally Redundant in Streaming Videos☆133Jun 29, 2026Updated 2 months ago
- Awesome latest models, datasets and benchmarks on streaming/online video understanding.☆31Oct 19, 2025Updated 10 months ago
- LVOmniBench: Pioneering Long Audio-Video Understanding Evaluation for Omnimodal LLMs☆42Apr 2, 2026Updated 4 months ago
- [CVPR 2026] OmniZip: Audio-Guided Dynamic Token Compression for Fast Omnimodal Large Language Models☆106Apr 20, 2026Updated 4 months ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- [ICCV2023] PyTorch implementation of ''Spatial-Aware Token for Weakly Supervised Object Localization''.☆23Oct 24, 2023Updated 2 years ago
- Agentic MLLMs☆215Oct 24, 2025Updated 10 months ago
- Reading notes about Multimodal Large Language Models, Large Language Models, and Diffusion Models☆1,196Jul 14, 2026Updated last month
- Latest Advances on (RL based) Multimodal Reasoning and Generation in Multimodal LLMs☆93Aug 22, 2026Updated last week
- [CVPR 2026] Wavelet-based Frame Selection by Detecting Semantic Boundary for Long Video Understanding☆33Apr 12, 2026Updated 4 months ago
- [ECCV 26] Video Streaming Thinking☆122Jul 28, 2026Updated last month
- LongVALE: Vision-Audio-Language-Event Benchmark Towards Time-Aware Omni-Modal Perception of Long Videos. (CVPR 2025))☆62Jun 9, 2025Updated last year
- Benchmarking and Bridging Emotion Conflicts for Multimodal Emotion Reasoning (ACM MM 2025 Oral)☆41Oct 11, 2025Updated 10 months ago
- ☆194Feb 8, 2025Updated last year
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- [ICLR'25] Official repository for "AVHBench: A Cross-Modal Hallucination Evaluation for Audio-Visual Large Language Models"☆26Mar 8, 2026Updated 5 months ago
- Awesome List for On-Policy Distillation☆846Updated this week
- 🔥An open-source survey of the latest video reasoning tasks, paradigms, and benchmarks.☆191Jun 14, 2026Updated 2 months ago
- ☆20Jul 21, 2025Updated last year
- Ke-Omni-R is an advanced audio reasoning model and achieved SOTA on MMAU☆62Jun 11, 2025Updated last year
- 📖 This is a repository for organizing papers, codes, and other resources related to unified multimodal models.☆365Jan 8, 2026Updated 7 months ago
- [ICLR26] ThinkOmni: Lifting Textual Reasoning to Omni-modal Scenarios via Guidance Decoding☆86Mar 20, 2026Updated 5 months ago