HumanMLLM / Omni-EmotionLinks
☆21Updated 6 months ago
Alternatives and similar repositories for Omni-Emotion
Users that are interested in Omni-Emotion are comparing it to the libraries listed below
Sorting:
- [ECCV’24] Official Implementation for CAT: Enhancing Multimodal Large Language Model to Answer Questions in Dynamic Audio-Visual Scenario…☆54Updated 11 months ago
- Explainable Multimodal Emotion Reasoning (EMER), OV-MER （ICML), and AffectGPT （ICML, Oral)☆215Updated this week
- MIntRec2.0 is the first large-scale dataset for multimodal intent recognition and out-of-scope detection in multi-party conversations (IC…☆54Updated last month
- GPT-4V with Emotion☆93Updated last year
- This is for ACL 2025 Findings Paper: From Specific-MLLMs to Omni-MLLMs: A Survey on MLLMs Aligned with Multi-modalitiesModels☆45Updated 2 weeks ago
- OpenOmni: Official implementation of Advancing Open-Source Omnimodal Large Language Models with Progressive Multimodal Alignment and Rea…☆91Updated last month
- EchoInk-R1: Exploring Audio-Visual Reasoning in Multimodal LLMs via Reinforcement Learning [🔥The Exploration of R1 for General Audio-Vi…☆47Updated 2 months ago
- ☆22Updated 3 months ago
- HumanOmni☆189Updated 4 months ago
- [Information Fusion 2024] HiCMAE: Hierarchical Contrastive Masked Autoencoder for Self-Supervised Audio-Visual Emotion Recognition☆111Updated 9 months ago
- a fully open-source implementation of a GPT-4o-like speech-to-speech video understanding model.☆21Updated 4 months ago
- [CVPR 2024] EmoVIT: Revolutionizing Emotion Insights with Visual Instruction Tuning☆34Updated 3 months ago
- av-SALMONN: Speech-Enhanced Audio-Visual Large Language Models☆13Updated last year
- Official PyTorch implementation of EMOVA in CVPR 2025 (https://arxiv.org/abs/2409.18042)☆60Updated 4 months ago
- ☆33Updated 2 months ago
- ☆23Updated 3 months ago
- ☆31Updated 3 weeks ago
- Unified Audio-Visual Perception for Multi-Task Video Localization☆24Updated last year
- TCL-MAP is a powerful method for multimodal intent recognition (AAAI 2024)☆45Updated last year
- EmoLLM: Multimodal Emotional Understanding Meets Large Language Models☆15Updated last year
- Toolkits for Multimodal Emotion Recognition☆237Updated 2 months ago
- Emotion-LLaMA: Multimodal Emotion Recognition and Reasoning with Instruction Tuning☆376Updated this week
- [CVPR 2025] Crab: A Unified Audio-Visual Scene Understanding Model with Explicit Cooperation☆58Updated 2 months ago
- Welcome to the official repository of Emotion-Qwen.☆17Updated last month
- A comprehensive overview of affective computing research in the era of large language models (LLMs).☆25Updated last year
- Official source codes for the paper: EmoDubber: Towards High Quality and Emotion Controllable Movie Dubbing.☆24Updated 2 months ago
- The code repo for ICASSP 2023 Paper "MMCosine: Multi-Modal Cosine Loss Towards Balanced Audio-Visual Fine-Grained Learning"☆21Updated 2 years ago
- [CVPR 2024 Highlight] Official implementation of the paper: Cooperation Does Matter: Exploring Multi-Order Bilateral Relations for Audio-…☆40Updated 3 months ago
- [ICML'25 Spotlight] Catch Your Emotion: Sharpening Emotion Perception in Multimodal Large Language Models☆17Updated last week
- Sparrow: Data-Efficient Video-LLM with Text-to-Image Augmentation☆30Updated 4 months ago