sunlicai / HiCMAE
[Information Fusion 2024] HiCMAE: Hierarchical Contrastive Masked Autoencoder for Self-Supervised Audio-Visual Emotion Recognition
☆100Updated 5 months ago
Alternatives and similar repositories for HiCMAE:
Users that are interested in HiCMAE are comparing it to the libraries listed below
- GPT-4V with Emotion☆89Updated last year
- Official repository for "eMotions: A Large-Scale Dataset for Emotion Recognition in Short Videos"☆33Updated 9 months ago
- Explainable Multimodal Emotion Reasoning (EMER) and AffectGPT☆144Updated 11 months ago
- Toolkits for Multimodal Emotion Recognition☆195Updated 10 months ago
- This repository provides the codes for MMA-DFER: multimodal (audiovisual) emotion recognition method. This is an official implementation …☆30Updated 6 months ago
- [BMVC'23] Prompting Visual-Language Models for Dynamic Facial Expression Recognition☆122Updated 4 months ago
- [CVPR 2023] Official code repository for "How you feelin'? Learning Emotions and Mental States in Movie Scenes". https://arxiv.org/abs/23…☆56Updated 5 months ago
- [CVPR 2023] Code for "Learning Emotion Representations from Verbal and Nonverbal Communication"☆47Updated last month
- [CVPR 2023] This is the official implementation of "Weakly Supervised Video Emotion Detection and Prediction via Cross-Modal Temporal Era…☆38Updated 2 months ago
- ☆17Updated 9 months ago
- GCNet, official pytorch implementation of our paper "GCNet: Graph Completion Network for Incomplete Multimodal Learning in Conversation"☆77Updated last year
- [EMNLP2023] Conversation Understanding using Relational Temporal Graph Neural Networks with Auxiliary Cross-Modality Interaction☆63Updated 8 months ago
- Emotion Recognition ToolKit (ERTK): tools for emotion recognition. Dataset processing, feature extraction, experiments,☆57Updated 4 months ago
- Code for the InterSpeech 2023 paper: MMER: Multimodal Multi-task learning for Speech Emotion Recognition☆72Updated last year
- ☆22Updated last year
- A Facial Expression-Aware Multimodal Multi-task Learning Framework for Emotion Recognition in Multi-party Conversations (ACL 2023)☆66Updated 5 months ago
- [CVPR 2024] EmoVIT: Revolutionizing Emotion Insights with Visual Instruction Tuning☆29Updated 6 months ago
- ☆16Updated 4 months ago
- We achieved the 2nd and 3rd places in ABAW3 and ABAW5, respectively.☆27Updated last year
- ☆233Updated last year
- IEEE T-BIOM : "Audio-Visual Fusion for Emotion Recognition in the Valence-Arousal Space Using Joint Cross-Attention"☆37Updated 4 months ago
- Efficient Multimodal Transformer with Dual-Level Feature Restoration for Robust Multimodal Sentiment Analysis (TAC 2023)☆58Updated 6 months ago
- av-SALMONN: Speech-Enhanced Audio-Visual Large Language Models☆14Updated 10 months ago
- ☆18Updated 11 months ago
- ☆20Updated 5 months ago
- PyTorch implementation for Audio-Visual Domain Adaptation Feature Fusion for Speech Emotion Recognition☆12Updated 3 years ago
- MAE-DFER: Efficient Masked Autoencoder for Self-supervised Dynamic Facial Expression Recognition (ACM MM 2023)☆109Updated 6 months ago
- FG2021: Cross Attentional AV Fusion for Dimensional Emotion Recognition☆27Updated 4 months ago
- FRAME-LEVEL EMOTIONAL STATE ALIGNMENT METHOD FOR SPEECH EMOTION RECOGNITION☆18Updated 3 months ago
- An official implementation of "Decoupled Multimodal Distilling for Emotion Recognition" in PyTorch. (CVPR 2023 highlight)☆108Updated last year