pliang279 / MultiBench
[NeurIPS 2021] Multiscale Benchmarks for Multimodal Representation Learning
☆488Updated 9 months ago
Related projects ⓘ
Alternatives and complementary repositories for MultiBench
- ☆178Updated 11 months ago
- [ACL'19] [PyTorch] Multimodal Transformer☆820Updated 2 years ago
- MISA: Modality-Invariant and -Specific Representations for Multimodal Sentiment Analysis☆199Updated last year
- This repository is build in association with our position paper on "Multimodality for NLP-Centered Applications: Resources, Advances and …☆251Updated 2 years ago
- This repository contains various models targetting multimodal representation learning, multimodal fusion for downstream tasks such as mul…☆750Updated last year
- The repo for "Balanced Multimodal Learning via On-the-fly Gradient Modulation", CVPR 2022 (ORAL)☆237Updated 4 months ago
- ☆169Updated last year
- MMSA is a unified framework for Multimodal Sentiment Analysis.☆685Updated 3 weeks ago
- A Tool for extracting multimodal features from videos.☆141Updated last year
- An official implementation of "Decoupled Multimodal Distilling for Emotion Recognition" in PyTorch. (CVPR 2023 highlight)☆96Updated last year
- Codes for paper "Learning Modality-Specific Representations with Self-Supervised Multi-Task Learning for Multimodal Sentiment Analysis"☆190Updated 2 years ago
- Data parser for the CMU-MultimodalSDK package including parsing for CMU-MOSEI, CMU-MOSI, and POM datasets☆27Updated 2 months ago
- M-SENA: All-in-One Platform for Multimodal Sentiment Analysis☆81Updated 2 years ago
- Multi-Modality Multi-Loss Fusion Network☆58Updated 3 months ago
- Code for the paper 'Dynamic Multimodal Fusion'☆88Updated last year
- A Transformer-based joint-encoding for Emotion Recognition and Sentiment Analysis☆118Updated 2 years ago
- Pytorch implementation of SMIL: Multimodal Learning with Severely Missing Modality (AAAI 2021)☆91Updated 2 years ago
- This repository contains the official implementation code of the paper Improving Multimodal Fusion with Hierarchical Mutual Information M…☆164Updated last year
- GCNet, official pytorch implementation of our paper "GCNet: Graph Completion Network for Incomplete Multimodal Learning in Conversation"☆68Updated last year
- ☆194Updated 2 years ago
- Explainable Multimodal Emotion Reasoning (EMER) and AffectGPT☆119Updated 6 months ago
- Pytorch implementation for Tailor Versatile Multi-modal Learning for Multi-label Emotion Recognition☆55Updated last year
- This is a short tutorial for using the CMU-MultimodalSDK.☆78Updated 5 years ago
- ☆83Updated last year
- Code for ALBEF: a new vision-language pre-training method☆1,557Updated 2 years ago
- Multimodal Prompting with Missing Modalities for Visual Recognition, CVPR'23☆172Updated 10 months ago
- [T-PAMI] A curated list of self-supervised multimodal learning resources.☆220Updated 2 months ago
- Toolkits for Multimodal Emotion Recognition☆160Updated 5 months ago
- METER: A Multimodal End-to-end TransformER Framework☆361Updated last year