HumanMLLM / Omni-EmotionLinks
☆21Updated 7 months ago
Alternatives and similar repositories for Omni-Emotion
Users that are interested in Omni-Emotion are comparing it to the libraries listed below
Sorting:
- EchoInk-R1: Exploring Audio-Visual Reasoning in Multimodal LLMs via Reinforcement Learning [🔥The Exploration of R1 for General Audio-Vi…☆53Updated 3 months ago
- [ECCV’24] Official Implementation for CAT: Enhancing Multimodal Large Language Model to Answer Questions in Dynamic Audio-Visual Scenario…☆55Updated 11 months ago
- This is for ACL 2025 Findings Paper: From Specific-MLLMs to Omni-MLLMs: A Survey on MLLMs Aligned with Multi-modalitiesModels☆49Updated last month
- GPT-4V with Emotion☆94Updated last year
- OpenOmni: Official implementation of Advancing Open-Source Omnimodal Large Language Models with Progressive Multimodal Alignment and Rea…☆95Updated 2 months ago
- [CVPR 2025] Crab: A Unified Audio-Visual Scene Understanding Model with Explicit Cooperation☆65Updated 2 months ago
- Explainable Multimodal Emotion Reasoning (EMER), OV-MER (ICML), and AffectGPT (ICML, Oral)☆233Updated 3 weeks ago
- MIntRec2.0 is the first large-scale dataset for multimodal intent recognition and out-of-scope detection in multi-party conversations (IC…☆57Updated 2 weeks ago
- ☆31Updated last month
- Official PyTorch implementation of EMOVA in CVPR 2025 (https://arxiv.org/abs/2409.18042)☆65Updated 5 months ago
- ☆22Updated 4 months ago
- ☆35Updated this week
- [Information Fusion 2024] HiCMAE: Hierarchical Contrastive Masked Autoencoder for Self-Supervised Audio-Visual Emotion Recognition☆110Updated last week
- a fully open-source implementation of a GPT-4o-like speech-to-speech video understanding model.☆25Updated 4 months ago
- Unified Audio-Visual Perception for Multi-Task Video Localization☆27Updated last year
- [ICML'25 Spotlight] Catch Your Emotion: Sharpening Emotion Perception in Multimodal Large Language Models☆20Updated this week
- [CVPR 2024] EmoVIT: Revolutionizing Emotion Insights with Visual Instruction Tuning☆36Updated 4 months ago
- HumanOmni☆193Updated 5 months ago
- NeurIPS'2023 official implementation code☆65Updated last year
- av-SALMONN: Speech-Enhanced Audio-Visual Large Language Models☆13Updated last year
- TCL-MAP is a powerful method for multimodal intent recognition (AAAI 2024)☆45Updated last year
- Official source codes for the paper: EmoDubber: Towards High Quality and Emotion Controllable Movie Dubbing.☆27Updated 2 months ago
- Video Chain of Thought, Codes for ICML 2024 paper: "Video-of-Thought: Step-by-Step Video Reasoning from Perception to Cognition"☆159Updated 6 months ago
- [CVPR 2024 Highlight] Official implementation of the paper: Cooperation Does Matter: Exploring Multi-Order Bilateral Relations for Audio-…☆38Updated 4 months ago
- This repository contains code for AAAI2025 paper "Dense Audio-Visual Event Localization under Cross-Modal Consistency and Multi-Temporal …☆21Updated last week
- ☆168Updated 6 months ago
- DeepDubber-V1: Towards High Quality and Dialogue, Narration, Monologue Adaptive Movie Dubbing Via Multi-Modal Chain-of-Thoughts Reasoning…☆25Updated 2 months ago
- Welcome to the official repository of Emotion-Qwen.☆18Updated 2 months ago
- [2025 CVPR] Towards Open-Vocabulary Audio-Visual Event Localization☆27Updated 5 months ago
- EmoLLM: Multimodal Emotional Understanding Meets Large Language Models☆16Updated last year