Alternatives and similar repositories for HighMMT

Users that are interested in HighMMT are comparing it to the libraries listed below

• pliang279 / MultiViz
  [ICLR 2023] MultiViz: Towards Visualizing and Understanding Multimodal Models
  ☆96Updated 10 months ago
• pliang279 / FactorCL
  [NeurIPS 2023] Factorized Contrastive Learning: Going Beyond Multi-view Redundancy
  ☆69Updated last year
• young-geng / m3ae_public
  Multimodal Masked Autoencoders (M3AE): A JAX/Flax Implementation
  ☆103Updated 4 months ago
• google-research / head2toe
  ☆81Updated 11 months ago
• goel-shashank / CyCLIP
  ☆120Updated 2 years ago
• miguelsvasco / gmc
  Official Implementation of "Geometric Multimodal Contrastive Representation Learning" (https://arxiv.org/abs/2202.03390)
  ☆28Updated 6 months ago
• NewsStoriesData / newsstories.github.io
  ☆22Updated 2 years ago
• facebookresearch / reliable_vqa
  Implementation for the paper "Reliable Visual Question Answering Abstain Rather Than Answer Incorrectly" (ECCV 2022: https//arxiv.org/abs…
  ☆34Updated 2 years ago
• lucidrains / zorro-pytorch
  Implementation of Zorro, Masked Multimodal Transformer, in Pytorch
  ☆97Updated last year
• haoliuhl / language-quantized-autoencoders
  Language Quantized AutoEncoders
  ☆107Updated 2 years ago
• google-deepmind / multimodal_transformers
  ☆65Updated 3 years ago
• sjunhongshen / ORCA
  Official implementation of ORCA proposed in the paper "Cross-Modal Fine-Tuning: Align then Refine"
  ☆71Updated last year
• IntelLabs / VL-InterpreT
  Visual Language Transformer Interpreter - An interactive visualization tool for interpreting vision-language transformers
  ☆94Updated last year
• serre-lab / CVR
  A Benchmark for Efficient and Compositional Visual Reasoning
  ☆25Updated last year
• yuhui-zh15 / drml
  Official Code Release for "Diagnosing and Rectifying Vision Models using Language" (ICLR 2023)
  ☆34Updated 2 years ago
• YugeTen / adios
  ☆65Updated 3 years ago
• bfshi / VARS
  Official code for `Visual Attention Emerges from Recurrent Sparse Reconstruction' (ICML 2022)
  ☆36Updated 3 years ago
• mlfoundations / patching
  Patching open-vocabulary models by interpolating weights
  ☆91Updated last year
• pliang279 / HEMM
  Holistic evaluation of multimodal foundation models
  ☆48Updated 11 months ago
• Jielin-Qiu / MM_Robustness
  [DMLR 2024] Benchmarking Robustness of Multimodal Image-Text Models under Distribution Shift
  ☆37Updated last year
• mshukor / eP-ALM
  [ICCV23] Official implementation of eP-ALM: Efficient Perceptual Augmentation of Language Models.
  ☆27Updated last year
• ExplainableML / fomo_in_flux
  Code and benchmark for the paper: "A Practitioner's Guide to Continual Multimodal Pretraining" [NeurIPS'24]
  ☆57Updated 7 months ago
• alextamkin / dabs
  A Domain-Agnostic Benchmark for Self-Supervised Learning
  ☆107Updated 2 years ago
• salesforce / hierarchicalContrastiveLearning
  ☆160Updated last month
• lucidrains / mirasol-pytorch
  Implementation of 🌻 Mirasol, SOTA Multimodal Autoregressive model out of Google Deepmind, in Pytorch
  ☆89Updated last year
• GLAMOR-USC / CLiMB
  The Continual Learning in Multimodality Benchmark
  ☆67Updated 2 years ago
• chingyaoc / RINCE
  CVPR 2022, Robust Contrastive Learning against Noisy Views
  ☆83Updated 3 years ago
• pliang279 / PID
  [NeurIPS 2023, ICMI 2023] Quantifying & Modeling Multimodal Interactions
  ☆77Updated 8 months ago
• sIncerass / MVLPT
  code for "Multitask Vision-Language Prompt Tuning" https://arxiv.org/abs/2211.11720
  ☆56Updated last year
• zinengtang / Perceiver_VL
  PyTorch code for "Perceiver-VL: Efficient Vision-and-Language Modeling with Iterative Latent Attention" (WACV 2023)
  ☆33Updated 2 years ago