Alternatives and similar repositories for MultiBench

Users that are interested in MultiBench are comparing it to the libraries listed below

• CMU-MultiComp-Lab / CMU-MultimodalSDK
  ☆248Updated last year
• yaohungt / Multimodal-Transformer
  [ACL'19] [PyTorch] Multimodal Transformer
  ☆877Updated 2 years ago
• declare-lab / MISA
  MISA: Modality-Invariant and -Specific Representations for Multimodal Sentiment Analysis
  ☆233Updated 2 years ago
• GeWu-Lab / OGM-GE_CVPR2022
  The repo for "Balanced Multimodal Learning via On-the-fly Gradient Modulation", CVPR 2022 (ORAL)
  ☆271Updated 4 months ago
• declare-lab / multimodal-deep-learning
  This repository contains various models targetting multimodal representation learning, multimodal fusion for downstream tasks such as mul…
  ☆836Updated 2 years ago
• Yutong-Zhou-cv / Awesome-Multimodality
  A Survey on multimodal learning research.
  ☆324Updated last year
• thuiar / MMSA-FET
  A Tool for extracting multimodal features from videos.
  ☆170Updated 2 years ago
• deep-real / SMIL
  Pytorch implementation of SMIL: Multimodal Learning with Severely Missing Modality (AAAI 2021)
  ☆106Updated 2 years ago
• pliang279 / MultiViz
  [ICLR 2023] MultiViz: Towards Visualizing and Understanding Multimodal Models
  ☆97Updated 8 months ago
• WasifurRahman / BERT_multimodal_transformer
  ☆200Updated 3 years ago
• thuiar / Self-MM
  Codes for paper "Learning Modality-Specific Representations with Self-Supervised Multi-Task Learning for Multimodal Sentiment Analysis"
  ☆213Updated 2 years ago
• salesforce / ALBEF
  Code for ALBEF: a new vision-language pre-training method
  ☆1,650Updated 2 years ago
• facebookresearch / multimodal
  TorchMultimodal is a PyTorch library for training state-of-the-art multimodal multi-task models at scale.
  ☆1,594Updated last week
• thuiar / MMSA
  MMSA is a unified framework for Multimodal Sentiment Analysis.
  ☆804Updated 4 months ago
• LeMei / UniMSE
  ☆189Updated 2 years ago
• pliang279 / HighMMT
  [TMLR 2022] High-Modality Multimodal Transformer
  ☆115Updated 6 months ago
• ys-zong / awesome-self-supervised-multimodal-learning
  [T-PAMI] A curated list of self-supervised multimodal learning resources.
  ☆252Updated 8 months ago
• drmuskangarg / Multimodal-datasets
  This repository is build in association with our position paper on "Multimodality for NLP-Centered Applications: Resources, Advances and …
  ☆290Updated 3 years ago
• zdou0830 / METER
  METER: A Multimodal End-to-end TransformER Framework
  ☆368Updated 2 years ago
• declare-lab / Multimodal-Infomax
  This repository contains the official implementation code of the paper Improving Multimodal Fusion with Hierarchical Mutual Information M…
  ☆183Updated 2 years ago
• thuiar / M-SENA
  M-SENA: All-in-One Platform for Multimodal Sentiment Analysis
  ☆88Updated 3 years ago
• pakoromilas / MultimodalSDK_loader
  Data parser for the CMU-MultimodalSDK package including parsing for CMU-MOSEI, CMU-MOSI, and POM datasets
  ☆33Updated 9 months ago
• jbdel / MOSEI_UMONS
  A Transformer-based joint-encoding for Emotion Recognition and Sentiment Analysis
  ☆124Updated 2 months ago
• Justin1904 / CMU-MultimodalSDK-Tutorials
  This is a short tutorial for using the CMU-MultimodalSDK.
  ☆85Updated 6 years ago
• YiLunLee / missing_aware_prompts
  Multimodal Prompting with Missing Modalities for Visual Recognition, CVPR'23
  ☆202Updated last year
• mdswyz / DMD
  An official implementation of "Decoupled Multimodal Distilling for Emotion Recognition" in PyTorch. (CVPR 2023 highlight)
  ☆114Updated last year
• muzairkhattak / multimodal-prompt-learning
  [CVPR 2023] Official repository of paper titled "MaPLe: Multi-modal Prompt Learning".
  ☆744Updated last year
• Eurus-Holmes / Awesome-Multimodal-Research
  A curated list of Multimodal Related Research.
  ☆1,348Updated last year
• thuiar / AWESOME-MSA
  Paper List for Multimodal Sentiment Analysis
  ☆100Updated 4 years ago
• zeroQiaoba / GCNet
  GCNet, official pytorch implementation of our paper "GCNet: Graph Completion Network for Incomplete Multimodal Learning in Conversation"
  ☆81Updated last week