pliang279 / MultiBench
[NeurIPS 2021] Multiscale Benchmarks for Multimodal Representation Learning
☆519Updated last year
Alternatives and similar repositories for MultiBench:
Users that are interested in MultiBench are comparing it to the libraries listed below
- ☆220Updated last year
- [ACL'19] [PyTorch] Multimodal Transformer☆860Updated 2 years ago
- MISA: Modality-Invariant and -Specific Representations for Multimodal Sentiment Analysis☆218Updated last year
- The repo for "Balanced Multimodal Learning via On-the-fly Gradient Modulation", CVPR 2022 (ORAL)☆256Updated last month
- This repository contains various models targetting multimodal representation learning, multimodal fusion for downstream tasks such as mul…☆806Updated last year
- [ICLR 2023] MultiViz: Towards Visualizing and Understanding Multimodal Models☆94Updated 6 months ago
- ☆179Updated last year
- A Survey on multimodal learning research.☆321Updated last year
- Pytorch implementation of SMIL: Multimodal Learning with Severely Missing Modality (AAAI 2021)☆98Updated 2 years ago
- This repository contains the official implementation code of the paper Improving Multimodal Fusion with Hierarchical Mutual Information M…☆177Updated last year
- [T-PAMI] A curated list of self-supervised multimodal learning resources.☆245Updated 6 months ago
- A Tool for extracting multimodal features from videos.☆158Updated 2 years ago
- ☆199Updated 3 years ago
- Codes for paper "Learning Modality-Specific Representations with Self-Supervised Multi-Task Learning for Multimodal Sentiment Analysis"☆206Updated 2 years ago
- This repository is build in association with our position paper on "Multimodality for NLP-Centered Applications: Resources, Advances and …☆275Updated 3 years ago
- M-SENA: All-in-One Platform for Multimodal Sentiment Analysis☆84Updated 2 years ago
- [TMLR 2022] High-Modality Multimodal Transformer☆111Updated 4 months ago
- METER: A Multimodal End-to-end TransformER Framework☆366Updated 2 years ago
- An official implementation of "Decoupled Multimodal Distilling for Emotion Recognition" in PyTorch. (CVPR 2023 highlight)☆107Updated last year
- MMSA is a unified framework for Multimodal Sentiment Analysis.☆745Updated last month
- This is the repository for "Efficient Low-rank Multimodal Fusion with Modality-Specific Factors", Liu and Shen, et. al. ACL 2018☆261Updated 4 years ago
- ☆22Updated 5 years ago
- [NeurIPS 2023, ICMI 2023] Quantifying & Modeling Multimodal Interactions☆67Updated 4 months ago
- Data parser for the CMU-MultimodalSDK package including parsing for CMU-MOSEI, CMU-MOSI, and POM datasets☆32Updated 6 months ago
- Multimodal Prompting with Missing Modalities for Visual Recognition, CVPR'23☆193Updated last year
- ☆85Updated 2 years ago
- Code for the paper 'Dynamic Multimodal Fusion'☆105Updated last year
- Multimodal Information Bottleneck: Learning Minimal Sufficient Unimodal and Multimodal Representations (MIB for multimodal sentiment anal…☆62Updated last year
- Offical implementation of paper "MSAF: Multimodal Split Attention Fusion"☆79Updated 3 years ago
- Explainable Multimodal Emotion Reasoning (EMER) and AffectGPT☆131Updated 10 months ago