EchoInk-R1: Exploring Audio-Visual Reasoning in Multimodal LLMs via Reinforcement Learning (🔥The Exploration of R1 for General Audio-Visual Reasoning with Qwen2.5-Omni)
☆80Jun 3, 2026Updated 5 months ago
Alternatives and similar repositories for EchoInk
Users that are interested in EchoInk are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- EchoTraffic: Enhancing Traffic Anomaly Understanding with Audio-Visual Insights (CVPR 2025)☆16Oct 7, 2026Updated last month
- This is the official repository of Daily-Omni: Towards Audio-Visual Reasoning with Temporal Alignment across Modalities☆54Oct 26, 2026Updated last week
- Code for "AudioMarathon: A Comprehensive Benchmark for Long-Context Audio Understanding and Efficiency in Audio LLMs"☆25Oct 9, 2025Updated last year
- [ICLR 2026] Data Pipeline, Models, and Benchmark for Omni-Captioner.☆146Apr 7, 2026Updated 7 months ago
- [ICLR'25] Official repository for "AVHBench: A Cross-Modal Hallucination Evaluation for Audio-Visual Large Language Models"☆27Mar 8, 2026Updated 7 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Ke-Omni-R is an advanced audio reasoning model and achieved SOTA on MMAU☆62Jun 11, 2025Updated last year
- ☆165Jul 31, 2025Updated last year
- [NeurIPS 2025] Official Repo of Omni-R1: Reinforcement Learning for Omnimodal Reasoning via Two-System Collaboration☆128Dec 3, 2025Updated 11 months ago
- [NeurIPS 2025] Watch and Listen: Understanding Audio-Visual-Speech Moments with Multimodal LLM☆27Aug 27, 2026Updated 2 months ago
- WorldSense: Evaluating Real-world Omnimodal Understanding for Multimodal LLMs☆51Jul 12, 2026Updated 3 months ago
- This is for ACL 2025 Findings Paper: From Specific-MLLMs to Omni-MLLMs: A Survey on MLLMs Aligned with Multi-modalitiesModels☆105Oct 13, 2026Updated 3 weeks ago
- ChronusOmni: Improving Time Awareness of Omni Large Language Models☆13Jan 18, 2026Updated 9 months ago
- ☆40Aug 26, 2025Updated last year
- OmniAgent (ICML 2026): the first native omni-modal agent for active video perception — a 7B agent that beats Qwen2.5-VL-72B with 73% fewe…☆86Sep 18, 2026Updated last month
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆18Jul 22, 2025Updated last year
- OmniVideo-100K: A Dataset for Audio-Visual Reasoning through Structured Scripts and Evidence Chains☆68Jul 8, 2026Updated 3 months ago
- This is a repository for fine-tuning Qwen2-Audio, currently supporting Distributed Data Parallel (DDP) and DeepSpeed.☆50Jul 28, 2025Updated last year
- This repo is the official implementation of "Stage-adaptive Token Selection for Efficient Omni-modal LLMs"☆20Oct 11, 2026Updated 3 weeks ago
- OmniInteract: Benchmarking Real-World Streaming Interaction for Real-Time Omnimodal Assistants☆24May 30, 2026Updated 5 months ago
- LUCY: Linguistic Understanding and Control Yielding Early Stage of Her☆61Apr 14, 2025Updated last year
- Implementation of NAACL 2024 paper Unveiling the Generalization Power of Fine-Tuned Large Language Models☆11Mar 14, 2024Updated 2 years ago
- Towards Fine-Grained Multi-Dimensional Speech Understanding: Data Pipeline, Benchmark, and Model☆29May 21, 2026Updated 5 months ago
- When Tone and Words Disagree: Towards Robust Speech Emotion Recognition under Acoustic-Semantic Conflict☆18Jan 7, 2026Updated 10 months ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- Long-RL: Scaling RL to Long Sequences (NeurIPS 2025)☆730Sep 24, 2025Updated last year
- (NIPS 2025) OpenOmni: Official implementation of Advancing Open-Source Omnimodal Large Language Models with Progressive Multimodal Align…☆145May 9, 2026Updated 5 months ago
- [ECCV 2026] Video-Holmes: Can MLLM Think Like Holmes for Complex Video Reasoning?☆101Jul 13, 2025Updated last year
- verl: Volcano Engine Reinforcement Learning for LLMs☆42Jun 23, 2025Updated last year
- Adaptive Multimodal Reasoning via Reinforcement Learning☆24Jan 11, 2026Updated 9 months ago
- This repo contains evaluation code for the paper "AV-Odyssey: Can Your Multimodal LLMs Really Understand Audio-Visual Information?"☆31Dec 23, 2024Updated last year
- [CVPR2026] VideoAuto-R1: Video Auto Reasoning via Thinking Once, Answering Twice☆90Feb 27, 2026Updated 8 months ago
- LongVALE: Vision-Audio-Language-Event Benchmark Towards Time-Aware Omni-Modal Perception of Long Videos. (CVPR 2025))☆65Jun 9, 2025Updated last year
- A Survey and Benchmark on Image and Video Shadow Detection, Removal, and Generation in the Era of Deep Learning (Awesome & Benchmark)☆109Feb 27, 2026Updated 8 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- OmniPro: A Comprehensive Benchmark for Omni-Proactive Streaming Video Understanding☆20Jul 27, 2026Updated 3 months ago
- Evaluating the Expressive Appropriateness of Speech in Rich Contexts☆18May 13, 2026Updated 5 months ago
- ☆21Sep 14, 2026Updated last month
- [CVPR 2026] See, Hear, and Understand: Benchmarking Audiovisual Human Speech Understanding in Multimodal Large Language Models☆12Apr 6, 2026Updated 7 months ago
- ☆15May 19, 2026Updated 5 months ago
- ✨First Open-Source R1-like Video-LLM [2025/02/18]☆384Oct 10, 2026Updated 3 weeks ago
- ☆35Sep 15, 2025Updated last year