Alternatives and similar repositories for HighMMT:

Users that are interested in HighMMT are comparing it to the libraries listed below

• pliang279 / MultiViz
  [ICLR 2023] MultiViz: Towards Visualizing and Understanding Multimodal Models
  ☆94Updated 6 months ago
• pliang279 / FactorCL
  [NeurIPS 2023] Factorized Contrastive Learning: Going Beyond Multi-view Redundancy
  ☆66Updated last year
• young-geng / m3ae_public
  Multimodal Masked Autoencoders (M3AE): A JAX/Flax Implementation
  ☆102Updated this week
• miguelsvasco / gmc
  Official Implementation of "Geometric Multimodal Contrastive Representation Learning" (https://arxiv.org/abs/2202.03390)
  ☆28Updated last month
• amazon-science / crossmodal-contrastive-learning
  CrossCLR: Cross-modal Contrastive Learning For Multi-modal Video Representations, ICCV 2021
  ☆62Updated 3 years ago
• goel-shashank / CyCLIP
  ☆117Updated 2 years ago
• pliang279 / PID
  [NeurIPS 2023, ICMI 2023] Quantifying & Modeling Multimodal Interactions
  ☆67Updated 4 months ago
• GLAMOR-USC / CLiMB
  The Continual Learning in Multimodality Benchmark
  ☆66Updated last year
• ninatu / everything_at_once
  Official implementation of "Everything at Once - Multi-modal Fusion Transformer for Video Retrieval". CVPR 2022
  ☆99Updated 2 years ago
• ilkerkesen / frozen
  A PyTorch implementation of Multimodal Few-Shot Learning with Frozen Language Models with OPT.
  ☆45Updated 2 years ago
• Weixin-Liang / Modality-Gap
  Mind the Gap: Understanding the Modality Gap in Multi-modal Contrastive Representation Learning
  ☆145Updated 2 years ago
• Jielin-Qiu / MM_Robustness
  [DMLR 2024] Benchmarking Robustness of Multimodal Image-Text Models under Distribution Shift
  ☆35Updated last year
• yanbeic / CCL
  PyTorch Implementation on Paper [CVPR2021]Distilling Audio-Visual Knowledge by Compositional Contrastive Learning
  ☆84Updated 3 years ago
• yangxuntu / lxmertcatt
  ☆73Updated 2 years ago
• md-mohaiminul / ViS4mer
  ☆54Updated 2 years ago
• fawazsammani / nlxgpt
  NLX-GPT: A Model for Natural Language Explanations in Vision and Vision-Language Tasks, CVPR 2022 (Oral)
  ☆48Updated last year
• MCR-PEFT / Ex-MCR
  ☆41Updated last year
• chingyaoc / RINCE
  CVPR 2022, Robust Contrastive Learning against Noisy Views
  ☆83Updated 3 years ago
• RERV / UniAdapter
  [ICLR2024] The official implementation of paper "UniAdapter: Unified Parameter-Efficient Transfer Learning for Cross-modal Modeling", by …
  ☆72Updated last year
• YiyangZhou / POVID
  [Arxiv] Aligning Modalities in Vision Large Language Models via Preference Fine-tuning
  ☆79Updated 10 months ago
• sIncerass / MVLPT
  code for "Multitask Vision-Language Prompt Tuning" https://arxiv.org/abs/2211.11720
  ☆55Updated 8 months ago
• google-research / fnc
  ☆26Updated 3 years ago
• yuhui-zh15 / drml
  Official Code Release for "Diagnosing and Rectifying Vision Models using Language" (ICLR 2023)
  ☆33Updated last year
• StanfordMIMI / villa
  [ICCV 2023] ViLLA: Fine-grained vision-language representation learning from real-world data
  ☆39Updated last year
• roudimit / AVLnet
  Code for the AVLnet (Interspeech 2021) and Cascaded Multilingual (Interspeech 2021) papers.
  ☆50Updated 2 years ago
• NewsStoriesData / newsstories.github.io
  ☆22Updated 2 years ago
• CHENGY12 / PLOT
  [ICLR2023] PLOT: Prompt Learning with Optimal Transport for Vision-Language Models
  ☆155Updated last year
• ylsung / VL_adapter
  PyTorch code for "VL-Adapter: Parameter-Efficient Transfer Learning for Vision-and-Language Tasks" (CVPR2022)
  ☆204Updated 2 years ago
• zinengtang / TVLT
  PyTorch code for “TVLT: Textless Vision-Language Transformer” (NeurIPS 2022 Oral)
  ☆121Updated 2 years ago
• pliang279 / HEMM
  Holistic evaluation of multimodal foundation models
  ☆42Updated 6 months ago