shock1ng / Mutil-Modal-wav2vec2.0-BERT
多模态，语音和文本结合的情感识别，大模型finetune
☆13Updated 11 months ago
Related projects ⓘ
Alternatives and complementary repositories for Mutil-Modal-wav2vec2.0-BERT
- A demo for multi-modal emotion recognition.(多模态情感识别demo)☆80Updated 7 months ago
- A Fully End2End Multimodal System for Fast Yet Effective Video Emotion Recognition☆30Updated 2 months ago
- This repository provides implementation for the paper "Self-attention fusion for audiovisual emotion recognition with incomplete data".☆107Updated last month
- Code for Speech Emotion Recognition with Co-Attention based Multi-level Acoustic Information☆125Updated 11 months ago
- Efficient Multimodal Transformer with Dual-Level Feature Restoration for Robust Multimodal Sentiment Analysis (TAC 2023)☆52Updated last month
- IEEE T-BIOM : "Audio-Visual Fusion for Emotion Recognition in the Valence-Arousal Space Using Joint Cross-Attention"☆31Updated 9 months ago
- [EMNLP2023] Conversation Understanding using Relational Temporal Graph Neural Networks with Auxiliary Cross-Modality Interaction☆44Updated 4 months ago
- "MULTIMODAL EMOTION RECOGNITION BASED ON DEEP TEMPORAL FEATURES USING CROSS-MODAL TRANSFORMER AND SELF-ATTENTION" ICASSP'23☆15Updated last year
- the baseline model of CMDC corpus☆31Updated 2 years ago
- Make Acoustic and Visual Cues Matter: CH-SIMS v2.0 Dataset and AV-Mixup Consistent Module☆58Updated 2 years ago
- The code for our IEEE ACCESS (2020) paper Multimodal Emotion Recognition with Transformer-Based Self Supervised Feature Fusion.☆113Updated 3 years ago
- MultiModal Sentiment Analysis architectures for CMU-MOSEI.☆37Updated last year
- depression-detect Predicting depression from AVEC2014 using ResNet18.☆39Updated 4 months ago
- MultiEMO: An Attention-Based Correlation-Aware Multimodal Fusion Framework for Emotion Recognition in Conversations (ACL 2023)☆48Updated 11 months ago
- TensorFlow code implementation of "MultiMAE-DER: Multimodal Masked Autoencoder for Dynamic Emotion Recognition"☆17Updated 2 weeks ago
- Source code for ICASSP 2022 paper "MM-DFN: Multimodal Dynamic Fusion Network For Emotion Recognition in Conversations"☆81Updated last year
- Code for paper "A Facial Expression-Aware Multimodal Multi-task Learning Framework for Emotion Recognition in Multi-party Conversations"☆56Updated this week
- Code for the InterSpeech 2023 paper: MMER: Multimodal Multi-task learning for Speech Emotion Recognition☆65Updated 7 months ago
- The code repository for NAACL 2021 paper "Multimodal End-to-End Sparse Model for Emotion Recognition".☆96Updated last year
- ☆13Updated 4 months ago
- Multi-Modality Multi-Loss Fusion Network☆58Updated 3 months ago
- Scripts used in the research described in the paper "Multimodal Emotion Recognition with High-level Speech and Text Features" accepted in…☆44Updated 3 years ago
- LI-FPN is an excellent model for depression recognition based on facial expression.☆13Updated 7 months ago
- code for paper 'Spatial-Temporal Attention Network for Depression Recognition from Facial Videos'☆23Updated 8 months ago
- ☆50Updated 8 months ago
- Bachelor Thesis - Deep Learning-based Multi-modal Depression Estimation☆53Updated last year
- This repository contains the official implementation code of the paper Transformer-based Feature Reconstruction Network for Robust Multim…☆28Updated last year
- Automatic Depression Detection: a GRU/ BiLSTM-based Model and An Emotional Audio-Textual Corpus☆136Updated last year
- ☆10Updated 11 months ago
- Toolkits for Multimodal Emotion Recognition☆160Updated 5 months ago