The code for our IEEE ACCESS (2020) paper Multimodal Emotion Recognition with Transformer-Based Self Supervised Feature Fusion.
☆123Sep 20, 2021Updated 4 years ago
Alternatives and similar repositories for Self-Supervised-Embedding-Fusion-Transformer
Users that are interested in Self-Supervised-Embedding-Fusion-Transformer are comparing it to the libraries listed below
Sorting:
- The code for our INTERSPEECH 2020 paper - Jointly Fine-Tuning "BERT-like'" Self Supervised Models to Improve Multimodal Speech Emotion R…☆120Feb 26, 2021Updated 5 years ago
- Modulated Fusion using Transformer for Linguistic-Acoustic Emotion Recognition☆32Dec 4, 2020Updated 5 years ago
- Modality-Transferable-MER, multimodal emotion recognition model with zero-shot and few-shot abilities.☆66Apr 23, 2021Updated 4 years ago
- A Tensorflow implementation of Speech Emotion Recognition using Audio signals and Text Data☆12May 16, 2022Updated 3 years ago
- A Pytorch implementation of emotion recognition from videos☆18Sep 15, 2020Updated 5 years ago
- This repository provides implementation for the paper "Self-attention fusion for audiovisual emotion recognition with incomplete data".☆160Sep 16, 2024Updated last year
- AuxFormer: Robust Approach to Audiovisual Emotion Recognition☆14Mar 14, 2023Updated 2 years ago
- Multimodal Fusion, Multimodal Sentiment Analysis☆26Jun 20, 2020Updated 5 years ago
- The code repository for NAACL 2021 paper "Multimodal End-to-End Sparse Model for Emotion Recognition".☆108Feb 9, 2023Updated 3 years ago
- Offical implementation of paper "MSAF: Multimodal Split Attention Fusion"☆81Jun 16, 2021Updated 4 years ago
- A demo for multi-modal emotion recognition.(多模态情感识别demo)☆92Apr 2, 2024Updated last year
- Source code for ICASSP 2022 paper "MM-DFN: Multimodal Dynamic Fusion Network For Emotion Recognition in Conversations".☆92Apr 21, 2023Updated 2 years ago
- This repository contains the code for our ICASSP paper `Speech Emotion Recognition using Semantic Information` https://arxiv.org/pdf/2103…☆27Mar 18, 2021Updated 4 years ago
- A fine multimodality fusion network :)☆11Aug 9, 2021Updated 4 years ago
- Multimodal Affective Analysis Using Hierarchical Attention Strategy☆12Dec 7, 2018Updated 7 years ago
- Human Emotion Understanding using multimodal dataset.☆110Jul 27, 2020Updated 5 years ago
- ☆12May 19, 2019Updated 6 years ago
- This repository contains the code for the paper `End-to-End Multimodal Emotion Recognition using Deep Neural Networks`.☆251Jan 22, 2021Updated 5 years ago
- Multimodal Transformer for Korean Sentiment Analysis with Audio and Text Features☆28Sep 7, 2021Updated 4 years ago
- 🔆 📝 A reading list focused on Multimodal Emotion Recognition (MER) 👂👄 👀 💬☆128Oct 6, 2020Updated 5 years ago
- Multimodal emotion recognition system of attention based vision network + audio network☆14Jul 21, 2020Updated 5 years ago
- This repository provides the ability to recoginize the emotion from video using audiovisual modalities。端到端的多模态情感识别代码☆11Mar 5, 2023Updated 3 years ago
- Attention-based multimodal fusion for sentiment analysis☆368Apr 8, 2024Updated last year
- Multimodal (text, acoustic, visual) Sentiment Analysis and Emotion Recognition on CMU-MOSEI dataset.☆29Nov 8, 2020Updated 5 years ago
- Multi-modal Speech Emotion Recogniton on IEMOCAP dataset☆95Jul 6, 2023Updated 2 years ago
- This repository contains various models targetting multimodal representation learning, multimodal fusion for downstream tasks such as mul…☆906Mar 15, 2023Updated 2 years ago
- ICASSP 2023: "Recursive Joint Attention for Audio-Visual Fusion in Regression Based Emotion Recognition"☆14Nov 29, 2024Updated last year
- Implementation of the paper "Multimodal Transformer With Learnable Frontend and Self Attention for Emotion Recognition" submitted to ICAS…☆28Oct 22, 2021Updated 4 years ago
- MultiModal Sentiment Analysis architectures for CMU-MOSEI.☆57Dec 9, 2022Updated 3 years ago
- Group Gated Fusion on Attention-based Bidirectional Alignment for Multimodal Emotion Recognition☆14May 10, 2022Updated 3 years ago
- Attention Based Multi-modal Emotion Recognition; Stanford Emotional Narratives Dataset☆17Aug 21, 2019Updated 6 years ago
- The Pytorch implementation of paper Multimodal fusion for alzheimer's disease recognition☆17Aug 23, 2022Updated 3 years ago
- Lightweight and Interpretable ML Model for Speech Emotion Recognition and Ambiguity Resolution (trained on IEMOCAP dataset)☆442Dec 21, 2023Updated 2 years ago
- Speech Emotion Classification with novel Parallel CNN-Transformer model built with PyTorch, plus thorough explanations of CNNs, Transform…☆264Nov 6, 2020Updated 5 years ago
- Chinese BERT classification with tf2.0 and audio classification with mfcc☆14Dec 2, 2020Updated 5 years ago
- Official PyTorch implementation of Multilogue-Net (Best paper runner-up at Challenge-HML @ ACL 2020)☆58Dec 8, 2022Updated 3 years ago
- TensorFlow implementation of "Multimodal Speech Emotion Recognition using Audio and Text," IEEE SLT-18☆298Jun 17, 2024Updated last year
- Official implementation for the paper Exploring Wav2vec 2.0 fine-tuning for improved speech emotion recognition☆153Oct 26, 2021Updated 4 years ago
- A multimodal approach on emotion recognition using audio and text.☆188Jun 15, 2020Updated 5 years ago