Alternatives and similar repositories for HighMMT

Users that are interested in HighMMT are comparing it to the libraries listed below

• pliang279 / MultiViz
  [ICLR 2023] MultiViz: Towards Visualizing and Understanding Multimodal Models
  ☆98Updated last year
• pliang279 / FactorCL
  [NeurIPS 2023] Factorized Contrastive Learning: Going Beyond Multi-view Redundancy
  ☆74Updated 2 years ago
• young-geng / m3ae_public
  Multimodal Masked Autoencoders (M3AE): A JAX/Flax Implementation
  ☆107Updated 10 months ago
• goel-shashank / CyCLIP
  ☆120Updated 2 years ago
• miguelsvasco / gmc
  Official Implementation of "Geometric Multimodal Contrastive Representation Learning" (https://arxiv.org/abs/2202.03390)
  ☆28Updated last year
• lucidrains / zorro-pytorch
  Implementation of Zorro, Masked Multimodal Transformer, in Pytorch
  ☆98Updated 2 years ago
• NewsStoriesData / newsstories.github.io
  ☆22Updated 3 years ago
• haoliuhl / language-quantized-autoencoders
  Language Quantized AutoEncoders
  ☆111Updated 2 years ago
• facebookresearch / reliable_vqa
  Implementation for the paper "Reliable Visual Question Answering Abstain Rather Than Answer Incorrectly" (ECCV 2022: https//arxiv.org/abs…
  ☆38Updated 2 years ago
• google-research / fnc
  ☆28Updated 4 years ago
• google-deepmind / multimodal_transformers
  ☆66Updated 3 years ago
• google-research / head2toe
  ☆81Updated last year
• amazon-science / crossmodal-contrastive-learning
  CrossCLR: Cross-modal Contrastive Learning For Multi-modal Video Representations, ICCV 2021
  ☆64Updated 3 years ago
• ExplainableML / fomo_in_flux
  Code and benchmark for the paper: "A Practitioner's Guide to Continual Multimodal Pretraining" [NeurIPS'24]
  ☆61Updated last year
• salesforce / paprika
  Code for CVPR 2023 paper "Procedure-Aware Pretraining for Instructional Video Understanding"
  ☆50Updated 11 months ago
• nyukat / greedy_multimodal_learning
  Characterizing and overcoming the greedy nature of learning in multi-modal deep neural networks
  ☆30Updated 3 years ago
• mshukor / eP-ALM
  [ICCV23] Official implementation of eP-ALM: Efficient Perceptual Augmentation of Language Models.
  ☆27Updated 2 years ago
• mlfoundations / patching
  Patching open-vocabulary models by interpolating weights
  ☆91Updated 2 years ago
• fawazsammani / nlxgpt
  NLX-GPT: A Model for Natural Language Explanations in Vision and Vision-Language Tasks, CVPR 2022 (Oral)
  ☆49Updated last year
• RERV / UniAdapter
  [ICLR2024] The official implementation of paper "UniAdapter: Unified Parameter-Efficient Transfer Learning for Cross-modal Modeling", by …
  ☆77Updated last year
• pliang279 / PID
  [NeurIPS 2023, ICMI 2023] Quantifying & Modeling Multimodal Interactions
  ☆84Updated last year
• yuhui-zh15 / drml
  Official Code Release for "Diagnosing and Rectifying Vision Models using Language" (ICLR 2023)
  ☆34Updated 2 years ago
• princetonvisualai / pointingqa
  Code for paper "Point and Ask: Incorporating Pointing into Visual Question Answering"
  ☆19Updated 3 years ago
• zinengtang / Perceiver_VL
  PyTorch code for "Perceiver-VL: Efficient Vision-and-Language Modeling with Iterative Latent Attention" (WACV 2023)
  ☆33Updated 2 years ago
• jmerullo / limber
  https://arxiv.org/abs/2209.15162
  ☆53Updated 2 years ago
• Jielin-Qiu / MM_Robustness
  [DMLR 2024] Benchmarking Robustness of Multimodal Image-Text Models under Distribution Shift
  ☆38Updated last year
• rvl-lab-utoronto / BFP
  Pytorch Implementation for "Preserving Linear Separability in Continual Learning by Backward Feature Projection" (CVPR 2023)
  ☆18Updated 2 years ago
• shizhediao / DaVinci
  Source code for the paper "Prefix Language Models are Unified Modal Learners"
  ☆44Updated 2 years ago
• mbanani / lgssl
  [CVPR 2023] Learning Visual Representations via Language-Guided Sampling
  ☆149Updated 2 years ago
• lucidrains / mirasol-pytorch
  Implementation of 🌻 Mirasol, SOTA Multimodal Autoregressive model out of Google Deepmind, in Pytorch
  ☆91Updated 2 years ago