[NeurIPS 2021] Multiscale Benchmarks for Multimodal Representation Learning
☆613Jan 27, 2024Updated 2 years ago
Alternatives and similar repositories for MultiBench
Users that are interested in MultiBench are comparing it to the libraries listed below
Sorting:
- ☆328Dec 4, 2023Updated 2 years ago
- [ACL'19] [PyTorch] Multimodal Transformer☆961Sep 12, 2022Updated 3 years ago
- [NeurIPS 2023, ICMI 2023] Quantifying & Modeling Multimodal Interactions☆86Oct 28, 2024Updated last year
- MMSA is a unified framework for Multimodal Sentiment Analysis.☆958Jan 15, 2025Updated last year
- This repository contains various models targetting multimodal representation learning, multimodal fusion for downstream tasks such as mul…☆905Mar 15, 2023Updated 2 years ago
- [ICLR 2023] MultiViz: Towards Visualizing and Understanding Multimodal Models☆99Aug 22, 2024Updated last year
- [TMLR 2022] High-Modality Multimodal Transformer☆117Nov 2, 2024Updated last year
- MISA: Modality-Invariant and -Specific Representations for Multimodal Sentiment Analysis☆274Mar 14, 2023Updated 2 years ago
- Reading list for research topics in multimodal machine learning☆6,821Aug 20, 2024Updated last year
- Offical implementation of paper "MSAF: Multimodal Split Attention Fusion"☆81Jun 16, 2021Updated 4 years ago
- repository for HapticLLaMA: A Multimodal Sensory Language Model for Haptic Captioning☆199Sep 3, 2025Updated 5 months ago
- This repository contains the official implementation code of the paper Improving Multimodal Fusion with Hierarchical Mutual Information M…☆196Mar 14, 2023Updated 2 years ago
- The repo for "Balanced Multimodal Learning via On-the-fly Gradient Modulation", CVPR 2022 (ORAL)☆310Sep 22, 2025Updated 5 months ago
- ☆13May 3, 2023Updated 2 years ago
- An official implementation of "Decoupled Multimodal Distilling for Emotion Recognition" in PyTorch. (CVPR 2023 highlight)☆147Jun 2, 2023Updated 2 years ago
- ☆213Dec 5, 2021Updated 4 years ago
- [NeurIPS 2023] Factorized Contrastive Learning: Going Beyond Multi-view Redundancy☆73Nov 13, 2023Updated 2 years ago
- Codes for paper "Learning Modality-Specific Representations with Self-Supervised Multi-Task Learning for Multimodal Sentiment Analysis"☆240Jun 25, 2022Updated 3 years ago
- [ICLR 2019] Learning Factorized Multimodal Representations☆67Aug 4, 2020Updated 5 years ago
- Multimodal Sarcasm Detection Dataset☆368Aug 22, 2024Updated last year
- Pytorch Implementation of Tensor Fusion Networks for multimodal sentiment analysis.☆195Apr 5, 2020Updated 5 years ago
- This repository contains the implementation of the paper -- Bi-Bimodal Modality Fusion for Correlation-Controlled Multimodal Sentiment An…☆72Apr 16, 2023Updated 2 years ago
- Multi-Modality Multi-Loss Fusion Network☆142Jul 28, 2024Updated last year
- Holistic evaluation of multimodal foundation models☆49Aug 11, 2024Updated last year
- This is a short tutorial for using the CMU-MultimodalSDK.☆87Mar 20, 2019Updated 6 years ago
- Code and dataset of "MEmoR: A Dataset for Multimodal Emotion Reasoning in Videos" in MM'20.☆55Jun 12, 2023Updated 2 years ago
- GCNet, official pytorch implementation of our paper "GCNet: Graph Completion Network for Incomplete Multimodal Learning in Conversation"☆96May 8, 2025Updated 9 months ago
- An official implementation of "Incomplete Multimodality-Diffused Emotion Recognition" in PyTorch. (NeurIPS 2023)☆62Dec 5, 2023Updated 2 years ago
- Pytorch implementation for Tailor Versatile Multi-modal Learning for Multi-label Emotion Recognition☆65Nov 16, 2022Updated 3 years ago
- [TMM2022] Source codes of CENet☆40Mar 14, 2023Updated 2 years ago
- Multi-modal Multi-label Emotion Recognition with Heterogeneous Hierarchical Message Passing☆18Sep 24, 2022Updated 3 years ago
- ☆27Aug 2, 2023Updated 2 years ago
- [ICLR 23 oral] The Modality Focusing Hypothesis: Towards Understanding Crossmodal Knowledge Distillation☆46Jul 10, 2023Updated 2 years ago
- Official PyTorch implementation of Multilogue-Net (Best paper runner-up at Challenge-HML @ ACL 2020)☆58Dec 8, 2022Updated 3 years ago
- Data parser for the CMU-MultimodalSDK package including parsing for CMU-MOSEI, CMU-MOSI, and POM datasets☆36Aug 15, 2024Updated last year
- This repository presents UR-FUNNY dataset: first dataset for multimodal humor detection☆152Jan 13, 2021Updated 5 years ago
- A Tool for extracting multimodal features from videos.☆206Feb 11, 2023Updated 3 years ago
- ☆29Jul 1, 2019Updated 6 years ago
- ☆39Jan 15, 2026Updated last month