PALMJJ / Multimodal-short-video-classification
Multimodal short video classification task, integrating video, image, audio and text modes for short video classification
☆19Updated 5 years ago
Alternatives and similar repositories for Multimodal-short-video-classification:
Users that are interested in Multimodal-short-video-classification are comparing it to the libraries listed below
- A Pytorch implementation of emotion recognition from videos☆17Updated 4 years ago
- Multimodal classification solution for the SIGIR eCOM using Co-attention and transformer language models☆19Updated 4 years ago
- Offical implementation of paper "MSAF: Multimodal Split Attention Fusion"☆80Updated 3 years ago
- The code for our IEEE ACCESS (2020) paper Multimodal Emotion Recognition with Transformer-Based Self Supervised Feature Fusion.☆117Updated 3 years ago
- Modulated Fusion using Transformer for Linguistic-Acoustic Emotion Recognition☆30Updated 4 years ago
- Multimodal Fusion, Multimodal Sentiment Analysis☆22Updated 4 years ago
- This repository contains the implementation of the paper -- Bi-Bimodal Modality Fusion for Correlation-Controlled Multimodal Sentiment An…☆70Updated last year
- Code on selecting an action based on multimodal inputs. Here in this case inputs are voice and text.☆71Updated 3 years ago
- CM-BERT: Cross-Modal BERT for Text-Audio Sentiment Analysis(MM2020)☆110Updated 4 years ago
- Codes for paper "Learning Modality-Specific Representations with Self-Supervised Multi-Task Learning for Multimodal Sentiment Analysis"☆207Updated 2 years ago
- codes for: Modality to Modality Translation: An Adversarial Representation Learning and Graph Fusion Network for Multimodal Fusion☆47Updated 3 years ago
- Philo: uniting modalities☆24Updated 2 weeks ago
- This paper list is about multimodal sentiment analysis.☆32Updated 3 years ago
- [AAAI 2020] Official implementation of VAANet for Emotion Recognition☆77Updated last year
- Multimodal Affective Analysis Using Hierarchical Attention Strategy☆12Updated 6 years ago
- Generalized cross-modal NNs; new audiovisual benchmark (IEEE TNNLS 2019)☆25Updated 4 years ago
- This repository contains the official implementation code of the paper Improving Multimodal Fusion with Hierarchical Mutual Information M…☆178Updated 2 years ago
- A Transformer-based joint-encoding for Emotion Recognition and Sentiment Analysis☆122Updated last month
- [AAAI 2018] Memory Fusion Network for Multi-view Sequential Learning☆113Updated 4 years ago
- Group Gated Fusion on Attention-based Bidirectional Alignment for Multimodal Emotion Recognition☆13Updated 2 years ago
- Pytorch Implementation of Tensor Fusion Networks for multimodal sentiment analysis.☆188Updated 4 years ago
- ☆19Updated 4 years ago
- Paper List for Multimodal Sentiment Analysis☆99Updated 4 years ago
- Code for NAACL 2021 paper: MTAG: Modal-Temporal Attention Graph for Unaligned Human Multimodal Language Sequences☆42Updated 2 years ago
- ☆63Updated 5 years ago
- PyTorch implementation of the models described in the IEEE ICASSP 2022 paper "Is cross-attention preferable to self-attention for multi-m…☆58Updated 2 years ago
- This is the repository for "Efficient Low-rank Multimodal Fusion with Modality-Specific Factors", Liu and Shen, et. al. ACL 2018☆262Updated 4 years ago
- multimodal social media content (text, image) classification☆50Updated 2 years ago
- A survey of deep multimodal emotion recognition.☆53Updated 2 years ago
- ☆17Updated 2 years ago