Alternatives and similar repositories for HighMMT

Users that are interested in HighMMT are comparing it to the libraries listed below

• pliang279 / MultiViz
  [ICLR 2023] MultiViz: Towards Visualizing and Understanding Multimodal Models
  ☆96Updated 10 months ago
• young-geng / m3ae_public
  Multimodal Masked Autoencoders (M3AE): A JAX/Flax Implementation
  ☆103Updated 4 months ago
• pliang279 / FactorCL
  [NeurIPS 2023] Factorized Contrastive Learning: Going Beyond Multi-view Redundancy
  ☆69Updated last year
• goel-shashank / CyCLIP
  ☆120Updated 2 years ago
• ninatu / everything_at_once
  Official implementation of "Everything at Once - Multi-modal Fusion Transformer for Video Retrieval." CVPR 2022
  ☆108Updated 2 years ago
• miguelsvasco / gmc
  Official Implementation of "Geometric Multimodal Contrastive Representation Learning" (https://arxiv.org/abs/2202.03390)
  ☆28Updated 5 months ago
• pliang279 / PID
  [NeurIPS 2023, ICMI 2023] Quantifying & Modeling Multimodal Interactions
  ☆75Updated 7 months ago
• lucidrains / zorro-pytorch
  Implementation of Zorro, Masked Multimodal Transformer, in Pytorch
  ☆97Updated last year
• facebookresearch / reliable_vqa
  Implementation for the paper "Reliable Visual Question Answering Abstain Rather Than Answer Incorrectly" (ECCV 2022: https//arxiv.org/abs…
  ☆33Updated 2 years ago
• GLAMOR-USC / CLiMB
  The Continual Learning in Multimodality Benchmark
  ☆67Updated 2 years ago
• amazon-science / crossmodal-contrastive-learning
  CrossCLR: Cross-modal Contrastive Learning For Multi-modal Video Representations, ICCV 2021
  ☆63Updated 3 years ago
• md-mohaiminul / ViS4mer
  ☆55Updated 2 years ago
• zhjohnchan / awesome-vision-and-language-pretraining
  A curated list of vision-and-language pre-training (VLP). :-)
  ☆59Updated 2 years ago
• Weixin-Liang / Modality-Gap
  Mind the Gap: Understanding the Modality Gap in Multi-modal Contrastive Representation Learning
  ☆158Updated 2 years ago
• google-research / fnc
  ☆27Updated 3 years ago
• roudimit / AVLnet
  Code for the AVLnet (Interspeech 2021) and Cascaded Multilingual (Interspeech 2021) papers.
  ☆52Updated 3 years ago
• salesforce / paprika
  Code for CVPR 2023 paper "Procedure-Aware Pretraining for Instructional Video Understanding"
  ☆49Updated 4 months ago
• ylsung / VL_adapter
  PyTorch code for "VL-Adapter: Parameter-Efficient Transfer Learning for Vision-and-Language Tasks" (CVPR2022)
  ☆205Updated 2 years ago
• yangxuntu / lxmertcatt
  ☆73Updated 2 years ago
• haoliuhl / language-quantized-autoencoders
  Language Quantized AutoEncoders
  ☆107Updated 2 years ago
• rowanz / merlot_reserve
  Code release for "MERLOT Reserve: Neural Script Knowledge through Vision and Language and Sound"
  ☆140Updated 3 years ago
• nyukat / greedy_multimodal_learning
  Characterizing and overcoming the greedy nature of learning in multi-modal deep neural networks
  ☆28Updated 3 years ago
• IntelLabs / VL-InterpreT
  Visual Language Transformer Interpreter - An interactive visualization tool for interpreting vision-language transformers
  ☆93Updated last year
• zinengtang / Perceiver_VL
  PyTorch code for "Perceiver-VL: Efficient Vision-and-Language Modeling with Iterative Latent Attention" (WACV 2023)
  ☆33Updated 2 years ago
• RERV / UniAdapter
  [ICLR2024] The official implementation of paper "UniAdapter: Unified Parameter-Efficient Transfer Learning for Cross-modal Modeling", by …
  ☆74Updated last year
• yanbeic / CCL
  PyTorch Implementation on Paper [CVPR2021]Distilling Audio-Visual Knowledge by Compositional Contrastive Learning
  ☆88Updated 3 years ago
• ys-zong / awesome-self-supervised-multimodal-learning
  [T-PAMI] A curated list of self-supervised multimodal learning resources.
  ☆261Updated 10 months ago
• mshukor / ViCHA
  [BMVC22] Official Implementation of ViCHA: "Efficient Vision-Language Pretraining with Visual Concepts and Hierarchical Alignment"
  ☆55Updated 2 years ago
• chingyaoc / RINCE
  CVPR 2022, Robust Contrastive Learning against Noisy Views
  ☆83Updated 3 years ago
• pliang279 / factorized
  [ICLR 2019] Learning Factorized Multimodal Representations
  ☆67Updated 4 years ago