sunlicai / HiCMAE
[Information Fusion 2024] HiCMAE: Hierarchical Contrastive Masked Autoencoder for Self-Supervised Audio-Visual Emotion Recognition
☆93Updated last month
Related projects ⓘ
Alternatives and complementary repositories for HiCMAE
- Toolkits for Multimodal Emotion Recognition☆163Updated 5 months ago
- GPT-4V with Emotion☆84Updated 11 months ago
- This repository provides the codes for MMA-DFER: multimodal (audiovisual) emotion recognition method. This is an official implementation …☆21Updated 2 months ago
- Explainable Multimodal Emotion Reasoning (EMER) and AffectGPT☆120Updated 6 months ago
- [BMVC'23] Prompting Visual-Language Models for Dynamic Facial Expression Recognition☆109Updated 7 months ago
- MAE-DFER: Efficient Masked Autoencoder for Self-supervised Dynamic Facial Expression Recognition (ACM MM 2023)☆93Updated last month
- Official repository for "eMotions: A Large-Scale Dataset for Emotion Recognition in Short Videos"☆31Updated 5 months ago
- Code for the InterSpeech 2023 paper: MMER: Multimodal Multi-task learning for Speech Emotion Recognition☆66Updated 8 months ago
- Emotion Recognition ToolKit (ERTK): tools for emotion recognition. Dataset processing, feature extraction, experiments,☆55Updated 2 weeks ago
- DWFormer: Dynamic Window Transformer for Speech Emotion Recognition(ICASSP 2023 Oral)☆51Updated 4 months ago
- [CVPR 2023] Code for "Learning Emotion Representations from Verbal and Nonverbal Communication"☆39Updated last year
- FRAME-LEVEL EMOTIONAL STATE ALIGNMENT METHOD FOR SPEECH EMOTION RECOGNITION☆16Updated last month
- [CVPR 2023] Official code repository for "How you feelin'? Learning Emotions and Mental States in Movie Scenes". https://arxiv.org/abs/23…☆57Updated last month
- [CVPR 2023] This is the official implementation of "Weakly Supervised Video Emotion Detection and Prediction via Cross-Modal Temporal Era…☆33Updated 4 months ago
- [EMNLP2023] Conversation Understanding using Relational Temporal Graph Neural Networks with Auxiliary Cross-Modality Interaction☆46Updated 4 months ago
- NeurIPS'2023 official implementation code☆59Updated last year
- [WACV 2023] Audio-Visual Efficient Conformer (AVEC) for Robust Speech Recognition☆92Updated last year
- IEEE T-BIOM : "Audio-Visual Fusion for Emotion Recognition in the Valence-Arousal Space Using Joint Cross-Attention"☆31Updated 9 months ago
- Emotion-LLaMA: Multimodal Emotion Recognition and Reasoning with Instruction Tuning☆116Updated this week
- GCNet, official pytorch implementation of our paper "GCNet: Graph Completion Network for Incomplete Multimodal Learning in Conversation"☆68Updated last year
- PyTorch implementation for Audio-Visual Domain Adaptation Feature Fusion for Speech Emotion Recognition☆12Updated 2 years ago
- Code for Speech Emotion Recognition with Co-Attention based Multi-level Acoustic Information☆129Updated 11 months ago
- Official implementation of RAVEn (ICLR 2023) and BRAVEn (ICASSP 2024)☆55Updated 4 months ago
- Official implement of SpeechFormer written in Python (PyTorch).☆75Updated last year
- We achieved the 2nd and 3rd places in ABAW3 and ABAW5, respectively.☆23Updated 8 months ago
- Official repository for our CVPR 2024 Workshop paper "Multi-Task Multi-Modal Self-Supervised Learning for Facial Expression Recognition".☆16Updated 5 months ago
- ☆21Updated last year
- AuxFormer: Robust Approach to Audiovisual Emotion Recognition☆14Updated last year
- Project to infere emotional expressions and benchmark datasets by Niklas Wagner, Felix Mätzler, Samed R. Vossberg, Helen Schneider and Sv…☆13Updated 6 months ago
- av-SALMONN: Speech-Enhanced Audio-Visual Large Language Models☆14Updated 6 months ago