razvan404 / multimodal-speech-emotion-recognition
Multimodal SER Model meant to be trained on recognising emotions from speech (text + acoustic data). Fine-tuned the DeBERTaV3 model, respectively the Wav2Vec2 model to extract the features and classify the emotions from the text, respectively audio data, then passed their features and their classification through an MLP to achieve better results…
☆10Updated 9 months ago
Alternatives and similar repositories for multimodal-speech-emotion-recognition:
Users that are interested in multimodal-speech-emotion-recognition are comparing it to the libraries listed below
- Scripts used in the research described in the paper "Multimodal Emotion Recognition with High-level Speech and Text Features" accepted in…☆52Updated 3 years ago
- IEEE T-BIOM : "Audio-Visual Fusion for Emotion Recognition in the Valence-Arousal Space Using Joint Cross-Attention"☆37Updated 3 months ago
- The code repository for NAACL 2021 paper "Multimodal End-to-End Sparse Model for Emotion Recognition".☆99Updated 2 years ago
- TensorFlow code implementation of "MultiMAE-DER: Multimodal Masked Autoencoder for Dynamic Emotion Recognition"☆18Updated 2 weeks ago
- The code for Multi-Scale Receptive Field Graph Model for Emotion Recognition in Conversations☆10Updated 2 years ago
- A Fully End2End Multimodal System for Fast Yet Effective Video Emotion Recognition☆37Updated 7 months ago
- This is the official code for paper "Speech Emotion Recognition with Global-Aware Fusion on Multi-scale Feature Representation" published…☆45Updated 2 years ago
- 多模态，语音和文本结合的情感识别，大模型finetune☆16Updated last year
- MultiModal Sentiment Analysis architectures for CMU-MOSEI.☆43Updated 2 years ago
- ABAW6 (CVPR-W) We achieved second place in the valence arousal challenge of ABAW6☆18Updated 10 months ago
- Code for the InterSpeech 2023 paper: MMER: Multimodal Multi-task learning for Speech Emotion Recognition☆72Updated last year
- FRAME-LEVEL EMOTIONAL STATE ALIGNMENT METHOD FOR SPEECH EMOTION RECOGNITION☆18Updated 3 months ago
- Multimodal emotion recognition system of attention based vision network + audio network☆14Updated 4 years ago
- Code for Speech Emotion Recognition with Co-Attention based Multi-level Acoustic Information☆139Updated last year
- PyTorch implementation for Audio-Visual Domain Adaptation Feature Fusion for Speech Emotion Recognition☆12Updated 3 years ago
- A survey of deep multimodal emotion recognition.☆53Updated 2 years ago
- Prosody-Aware Graph Neural Networks for Speech Emotion Recognition☆9Updated last year
- Multimodal (text, acoustic, visual) Sentiment Analysis and Emotion Recognition on CMU-MOSEI dataset.☆24Updated 4 years ago
- ☆13Updated 9 months ago
- Chinese BERT classification with tf2.0 and audio classification with mfcc☆14Updated 4 years ago
- AuxFormer: Robust Approach to Audiovisual Emotion Recognition☆14Updated 2 years ago
- This repository provides implementation for the paper "Self-attention fusion for audiovisual emotion recognition with incomplete data".☆128Updated 6 months ago
- The PyTorch code for paper: "CONSK-GCN: Conversational Semantic- and Knowledge-Oriented Graph Convolutional Network for Multimodal Emotio…☆11Updated 2 years ago
- Detect emotion from audio signals of IEMOCAP dataset using multi-modal approach. Utilized acoustic features, mel-spectrogram and text as …☆38Updated last year
- This repository contains the code for our ICASSP paper `Speech Emotion Recognition using Semantic Information` https://arxiv.org/pdf/2103…☆24Updated 4 years ago
- TensorFlow implementation of "Attentive Modality Hopping for Speech Emotion Recognition," ICASSP-20☆32Updated 4 years ago
- Source code for ICASSP 2022 paper "MM-DFN: Multimodal Dynamic Fusion Network For Emotion Recognition in Conversations".☆85Updated last year
- The code for our INTERSPEECH 2020 paper - Jointly Fine-Tuning "BERT-like'" Self Supervised Models to Improve Multimodal Speech Emotion R…☆120Updated 4 years ago
- Repository with the code of the paper: A proposal for Multimodal Emotion Recognition using auraltransformers and Action Units on RAVDESS …☆105Updated 11 months ago
- This repository provides the codes for MMA-DFER: multimodal (audiovisual) emotion recognition method. This is an official implementation …☆30Updated 6 months ago