pliang279 / HighMMT

Related projects ⓘ

Alternatives and complementary repositories for HighMMT

• pliang279 / MultiViz
  [ICLR 2023] MultiViz: Towards Visualizing and Understanding Multimodal Models
  ☆90Updated 2 months ago
• young-geng / m3ae_public
  Multimodal Masked Autoencoders (M3AE): A JAX/Flax Implementation
  ☆100Updated 7 months ago
• pliang279 / FactorCL
  [NeurIPS 2023] Factorized Contrastive Learning: Going Beyond Multi-view Redundancy
  ☆60Updated 11 months ago
• facebookresearch / reliable_vqa
  Implementation for the paper "Reliable Visual Question Answering Abstain Rather Than Answer Incorrectly" (ECCV 2022: https//arxiv.org/abs…
  ☆32Updated last year
• NewsStoriesData / newsstories.github.io
  ☆22Updated 2 years ago
• miguelsvasco / gmc
  Official Implementation of "Geometric Multimodal Contrastive Representation Learning" (https://arxiv.org/abs/2202.03390)
  ☆26Updated 2 years ago
• pliang279 / PID
  [NeurIPS 2023, ICMI 2023] Quantifying & Modeling Multimodal Interactions
  ☆60Updated last week
• GLAMOR-USC / CLiMB
  The Continual Learning in Multimodality Benchmark
  ☆60Updated last year
• amazon-science / crossmodal-contrastive-learning
  CrossCLR: Cross-modal Contrastive Learning For Multi-modal Video Representations, ICCV 2021
  ☆56Updated 2 years ago
• yuhui-zh15 / drml
  Official Code Release for "Diagnosing and Rectifying Vision Models using Language" (ICLR 2023)
  ☆32Updated last year
• ninatu / everything_at_once
  Official implementation of "Everything at Once - Multi-modal Fusion Transformer for Video Retrieval". CVPR 2022
  ☆94Updated 2 years ago
• lucidrains / zorro-pytorch
  Implementation of Zorro, Masked Multimodal Transformer, in Pytorch
  ☆95Updated last year
• goel-shashank / CyCLIP
  ☆113Updated last year
• google-research / fnc
  ☆25Updated 3 years ago
• haoliuhl / language-quantized-autoencoders
  Language Quantized AutoEncoders
  ☆94Updated last year
• Weixin-Liang / Modality-Gap
  Mind the Gap: Understanding the Modality Gap in Multi-modal Contrastive Representation Learning
  ☆123Updated 2 years ago
• YiyangZhou / POVID
  [Arxiv] Aligning Modalities in Vision Large Language Models via Preference Fine-tuning
  ☆71Updated 6 months ago
• EPFLiGHT / MultiModN
  MultiModN – Multimodal, Multi-Task, Interpretable Modular Networks (NeurIPS 2023)
  ☆30Updated last year
• Jielin-Qiu / MM_Robustness
  [DMLR 2024] Benchmarking Robustness of Multimodal Image-Text Models under Distribution Shift
  ☆33Updated 9 months ago
• StanfordMIMI / villa
  ViLLA: Fine-grained vision-language representation learning from real-world data
  ☆39Updated last year
• RERV / UniAdapter
  [ICLR2024] The official implementation of paper "UniAdapter: Unified Parameter-Efficient Transfer Learning for Cross-modal Modeling", by …
  ☆69Updated 9 months ago
• IntelLabs / VL-InterpreT
  Visual Language Transformer Interpreter - An interactive visualization tool for interpreting vision-language transformers
  ☆86Updated last year
• rowanz / merlot_reserve
  Code release for "MERLOT Reserve: Neural Script Knowledge through Vision and Language and Sound"
  ☆137Updated 2 years ago
• mshukor / ViCHA
  [BMVC22] Official Implementation of ViCHA: "Efficient Vision-Language Pretraining with Visual Concepts and Hierarchical Alignment"
  ☆53Updated 2 years ago
• ylsung / VL_adapter
  PyTorch code for "VL-Adapter: Parameter-Efficient Transfer Learning for Vision-and-Language Tasks" (CVPR2022)
  ☆202Updated last year
• yiren-jian / BLIText
  [NeurIPS 2023] Bootstrapping Vision-Language Learning with Decoupled Language Pre-training
  ☆24Updated 11 months ago
• md-mohaiminul / ViS4mer
  ☆52Updated 2 years ago
• ilkerkesen / frozen
  A PyTorch implementation of Multimodal Few-Shot Learning with Frozen Language Models with OPT.
  ☆43Updated 2 years ago
• sIncerass / MVLPT
  code for "Multitask Vision-Language Prompt Tuning" https://arxiv.org/abs/2211.11720
  ☆52Updated 5 months ago
• yangxuntu / lxmertcatt
  ☆70Updated 2 years ago