melanchthon19 / multimodal_cnnView external linksLinks
Multimodal (text, acoustic, visual) Sentiment Analysis and Emotion Recognition on CMU-MOSEI dataset.
☆29Nov 8, 2020Updated 5 years ago
Alternatives and similar repositories for multimodal_cnn
Users that are interested in multimodal_cnn are comparing it to the libraries listed below
Sorting:
- MultiModal Sentiment Analysis architectures for CMU-MOSEI.☆57Dec 9, 2022Updated 3 years ago
- Modality-Transferable-MER, multimodal emotion recognition model with zero-shot and few-shot abilities.☆66Apr 23, 2021Updated 4 years ago
- ☆16Aug 15, 2024Updated last year
- Multimodal emotion recognition system of attention based vision network + audio network☆14Jul 21, 2020Updated 5 years ago
- Multimodal Speech Recognition for phoneme level prediction using Audio-Visual data from TCDTIMIT dataset implementing RNNs with LSTMs for…☆15Jul 27, 2023Updated 2 years ago
- Multimodal Emotion Recognition in a video using feature level fusion of audio and visual modalities☆15Jul 5, 2018Updated 7 years ago
- Pytorch code for our TOMM2022 paper "A Multimodal framework for large scale Emotion Recognition by Fusing Music and Electrodermal Activit…☆35Mar 15, 2022Updated 3 years ago
- DeepCU: Integrating Both Common and Unique Latent Information for Multimodal Sentiment Analysis, IJCAI-19☆19Nov 21, 2019Updated 6 years ago
- Offical implementation of paper "MSAF: Multimodal Split Attention Fusion"☆81Jun 16, 2021Updated 4 years ago
- A Pytorch implementation of emotion recognition from videos☆19Sep 15, 2020Updated 5 years ago
- A demo for multi-modal emotion recognition.(多模态情感识别demo)☆91Apr 2, 2024Updated last year
- Multimodal Fusion, Multimodal Sentiment Analysis☆26Jun 20, 2020Updated 5 years ago
- The code repository for NAACL 2021 paper "Multimodal End-to-End Sparse Model for Emotion Recognition".☆108Feb 9, 2023Updated 3 years ago
- Multimodal Sentiment Analysis using unified transformer☆25Oct 11, 2022Updated 3 years ago
- Human Emotion Understanding using multimodal dataset.☆110Jul 27, 2020Updated 5 years ago
- A large-scale dataset for classification and detection of apple leaf diseases☆12Apr 1, 2023Updated 2 years ago
- Multimodal datasets.☆33Jan 26, 2024Updated 2 years ago
- The code for our IEEE ACCESS (2020) paper Multimodal Emotion Recognition with Transformer-Based Self Supervised Feature Fusion.☆123Sep 20, 2021Updated 4 years ago
- Multimodal Transformer for Korean Sentiment Analysis with Audio and Text Features☆28Sep 7, 2021Updated 4 years ago
- 缺陷检测是图像处理领域一个应用广泛的问题。本课题依托科研项目，采用无人机上的图像探测器采集工厂内部货架图片；通过图片配准及比对，识别螺丝松动等缺陷。从而防止隐患的发生。也可以使用公开数据集处理，课题主要是算法，不限制算法依托的软件平台。☆16Feb 20, 2024Updated last year
- Data parser for the CMU-MultimodalSDK package including parsing for CMU-MOSEI, CMU-MOSI, and POM datasets☆36Aug 15, 2024Updated last year
- Pre-training Cross-modal Transformer for Audio-and-Language Representations☆38Apr 20, 2021Updated 4 years ago
- Deployed a facial emotion recognition using neural network model which predicts the emotion from faces in images, videos and live feed fr…☆11May 2, 2021Updated 4 years ago
- Pytorch implementation for the paper: Adversarial alignment and graph fusion via information bottleneck for multimodal emotion recognitio…☆15Sep 19, 2024Updated last year
- [ACL 2023] Counterspeeches up my sleeve! Intent Distribution Learning and Persistent Fusion for Intent-Conditioned Counterspeech Generati…☆10Sep 23, 2023Updated 2 years ago
- 1st place solution to the DCASE 2020 - Task 5 - Urban Sound Tagging with Spatiotemporal Context☆16Dec 8, 2022Updated 3 years ago
- This repository shows how to implement a basic model for multimodal entailment.☆10Aug 17, 2021Updated 4 years ago
- ☆41Nov 14, 2022Updated 3 years ago
- Attention-based multimodal fusion for sentiment analysis☆366Apr 8, 2024Updated last year
- This repository contains the code for the paper `End-to-End Multimodal Emotion Recognition using Deep Neural Networks`.☆252Jan 22, 2021Updated 5 years ago
- A sentiment analysis of the image and the corresponding text comment, which is based on the convolution neural network (CNN).☆11May 27, 2017Updated 8 years ago
- A fine multimodality fusion network :)☆11Aug 9, 2021Updated 4 years ago
- ☆10Mar 24, 2023Updated 2 years ago
- A CNN audio classifier via spectrogram images.☆10Jul 21, 2017Updated 8 years ago
- ☆10Nov 10, 2021Updated 4 years ago
- PyTorch code for the Neurips 2021 paper: Fairness via Representation Neutralization☆10Oct 26, 2021Updated 4 years ago
- ☆12Oct 12, 2022Updated 3 years ago
- Multimodal SER Model meant to be trained on recognising emotions from speech (text + acoustic data). Fine-tuned the DeBERTaV3 model, resp…☆11Jun 19, 2024Updated last year
- FeelingBlue: A Corpus for Understanding the Emotional Connotation of Color in Context, accepted at TACL 2022, presented at ACL 2023☆12Dec 28, 2023Updated 2 years ago