Alternatives and similar repositories for multimodal_alignment

Users that are interested in multimodal_alignment are comparing it to the libraries listed below

• g-luo / vlm_cross_modal_reps
  Official PyTorch Implementation for Vision-Language Models Create Cross-Modal Task Representations, ICML 2025
  ☆31Updated 7 months ago
• OpenCausaLab / CELLO
  ☆21Updated last year
• tianyi-lab / R2-T2
  [ICML 2025] Code for "R2-T2: Re-Routing in Test-Time for Multimodal Mixture-of-Experts"
  ☆17Updated 9 months ago
• AV-Odyssey / AV-Odyssey
  This repo contains evaluation code for the paper "AV-Odyssey: Can Your Multimodal LLMs Really Understand Audio-Visual Information?"
  ☆31Updated last year
• ExplainableML / fomo_in_flux
  Code and benchmark for the paper: "A Practitioner's Guide to Continual Multimodal Pretraining" [NeurIPS'24]
  ☆61Updated last year
• princeton-pli / VLM_S2H
  Generalizing from SIMPLE to HARD Visual Reasoning: Can We Mitigate Modality Imbalance in VLMs?
  ☆15Updated 6 months ago
• microsoft / x-reasoner
  X-Reasoner: Towards Generalizable Reasoning Across Modalities and Domains
  ☆50Updated 7 months ago
• locuslab / llava-token-compression
  ☆46Updated last year
• pliang279 / HEMM
  Holistic evaluation of multimodal foundation models
  ☆47Updated last year
• XinrunXu / DeepPHY
  DeepPHY: Benchmarking Agentic VLMs on Physical Reasoning
  ☆165Updated last month
• ethanlshen / HierNet
  Code for "Are “Hierarchical” Visual Representations Hierarchical?" in NeurIPS Workshop for Symmetry and Geometry in Neural Representation…
  ☆21Updated 2 years ago
• qiuzh20 / RMoE
  Official implementation of RMoE (Layerwise Recurrent Router for Mixture-of-Experts)
  ☆27Updated last year
• mbzuai-oryx / Agent-X
  Evaluating Deep Multimodal Reasoning in Vision-Centric Agentic Tasks
  ☆33Updated last month
• jiaangli / VLCA
  Do Vision and Language Models Share Concepts? A Vector Space Alignment Study
  ☆16Updated last year
• UCSC-VLAA / Sight-Beyond-Text
  [TMLR 2024] Official implementation of "Sight Beyond Text: Multi-Modal Training Enhances LLMs in Truthfulness and Ethics"
  ☆20Updated 2 years ago
• shiqichen17 / AdaptVis
  Github repository for "Why Is Spatial Reasoning Hard for VLMs? An Attention Mechanism Perspective on Focus Areas" (ICML 2025)
  ☆65Updated 7 months ago
• VITA-Group / TAPE
  [ICML'25] "Rethinking Addressing in Language Models via Contextualized Equivariant Positional Encoding" by Jiajun Zhu, Peihao Wang, Ruisi…
  ☆14Updated 6 months ago
• lyan62 / vlm-info-loss
  ☆21Updated 3 months ago
• kigb / DropoutDecoding
  [NeurIPS 2025] Official Implementation for "Enhancing Vision-Language Model Reliability with Uncertainty-Guided Dropout Decoding"
  ☆22Updated last year
• WangFei-2019 / SNARE
  Project for SNARE benchmark
  ☆11Updated last year
• Optimization-AI / FastCLIP
  Distributed Optimization Infra for learning CLIP models
  ☆27Updated last year
• si0wang / ViCrit
  ☆24Updated 6 months ago
• s-vco / s-vco
  Symmetrical Visual Contrastive Optimization: Aligning Vision-Language Models with Minimal Contrastive Images
  ☆16Updated 6 months ago
• yuhui-zh15 / AutoConverter
  Official implementation of "Automated Generation of Challenging Multiple-Choice Questions for Vision Language Model Evaluation" (CVPR 202…
  ☆40Updated 7 months ago
• kokolerk / TON
  [NeurIPS 2025] Think or Not? Selective Reasoning via Reinforcement Learning for Vision-Language Models
  ☆52Updated 3 months ago
• ALT-JS / OthelloSAE
  CS194-196 Course Project
  ☆14Updated 10 months ago
• OpenNLPLab / HGRN2
  HGRN2: Gated Linear RNNs with State Expansion
  ☆56Updated last year
• TIGER-AI-Lab / VideoEval-Pro
  More reliable Video Understanding Evaluation
  ☆13Updated 3 months ago
• luka-group / vlm-knowledge-conflict
  Code for paper "Unraveling Cross-Modality Knowledge Conflicts in Large Vision-Language Models."
  ☆50Updated last year
• HelmholtzAI-FZJ / flex_gen
  ☆19Updated 11 months ago