HarryHsing / EchoInkLinks
EchoInk-R1: Exploring Audio-Visual Reasoning in Multimodal LLMs via Reinforcement Learning [π₯The Exploration of R1 for General Audio-Visual Reasoning with Qwen2.5-Omni]
β56Updated 4 months ago
Alternatives and similar repositories for EchoInk
Users that are interested in EchoInk are comparing it to the libraries listed below
Sorting:
- This is for ACL 2025 Findings Paper: From Specific-MLLMs to Omni-MLLMs: A Survey on MLLMs Aligned with Multi-modalitiesModelsβ59Updated last week
- Official PyTorch implementation of EMOVA in CVPR 2025 (https://arxiv.org/abs/2409.18042)β67Updated 6 months ago
- OpenOmni: Official implementation of Advancing Open-Source Omnimodal Large Language Models with Progressive Multimodal Alignment and Reaβ¦β98Updated 2 months ago
- A project for tri-modal LLM benchmarking and instruction tuning.β47Updated 5 months ago
- β35Updated 3 weeks ago
- a fully open-source implementation of a GPT-4o-like speech-to-speech video understanding model.β26Updated 5 months ago
- β21Updated 8 months ago
- [CVPR 2025] Crab: A Unified Audio-Visual Scene Understanding Model with Explicit Cooperationβ70Updated 3 months ago
- LMM solved catastrophic forgetting, AAAI2025β44Updated 5 months ago
- WorldSense: Evaluating Real-world Omnimodal Understanding for Multimodal LLMsβ29Updated last week
- Video Chain of Thought, Codes for ICML 2024 paper: "Video-of-Thought: Step-by-Step Video Reasoning from Perception to Cognition"β163Updated 6 months ago
- [ICCV 2025] Explore the Limits of Omni-modal Pretraining at Scaleβ115Updated last year
- [ICML 2025] Official implementation of paper 'Look Twice Before You Answer: Memory-Space Visual Retracing for Hallucination Mitigation inβ¦β150Updated 2 weeks ago
- [ECCVβ24] Official Implementation for CAT: Enhancing Multimodal Large Language Model to Answer Questions in Dynamic Audio-Visual Scenarioβ¦β55Updated last year
- LongVALE: Vision-Audio-Language-Event Benchmark Towards Time-Aware Omni-Modal Perception of Long Videos. (CVPR 2025))β51Updated 3 months ago
- Code for DeCo: Decoupling token compression from semanchc abstraction in multimodal large language modelsβ69Updated 2 months ago
- [CVPR'2025] VoCo-LLaMA: This repo is the official implementation of "VoCo-LLaMA: Towards Vision Compression with Large Language Models".β189Updated 3 months ago
- UnifiedMLLM: Enabling Unified Representation for Multi-modal Multi-tasks With Large Language Modelβ22Updated last year
- β33Updated 2 months ago
- β23Updated 4 months ago
- Latest Advances on Reasoning of Multimodal Large Language Models (Multimodal R1 \ Visual R1) ) πβ34Updated 5 months ago
- β42Updated 4 months ago
- [MM2024, oral] "Self-Supervised Visual Preference Alignment" https://arxiv.org/abs/2404.10501β56Updated last year
- β19Updated last year
- [ECCV 2024] Paying More Attention to Image: A Training-Free Method for Alleviating Hallucination in LVLMsβ140Updated 10 months ago
- This repo contains evaluation code for the paper "AV-Odyssey: Can Your Multimodal LLMs Really Understand Audio-Visual Information?"β28Updated 8 months ago
- β31Updated 3 months ago
- β55Updated 3 weeks ago
- HallE-Control: Controlling Object Hallucination in LMMsβ31Updated last year
- [Preprint] On the Generalization of SFT: A Reinforcement Learning Perspective with Reward Rectification.β448Updated this week