Alternatives and similar repositories for multimodal_alignment

Users that are interested in multimodal_alignment are comparing it to the libraries listed below

• g-luo / vlm_cross_modal_reps
  Official PyTorch Implementation for Vision-Language Models Create Cross-Modal Task Representations, ICML 2025
  ☆31Updated 8 months ago
• microsoft / x-reasoner
  X-Reasoner: Towards Generalizable Reasoning Across Modalities and Domains
  ☆50Updated 8 months ago
• tianyi-lab / R2-T2
  [ICML 2025] Code for "R2-T2: Re-Routing in Test-Time for Multimodal Mixture-of-Experts"
  ☆17Updated 10 months ago
• WangFei-2019 / SNARE
  Project for SNARE benchmark
  ☆11Updated last year
• princeton-pli / VLM_S2H
  Generalizing from SIMPLE to HARD Visual Reasoning: Can We Mitigate Modality Imbalance in VLMs?
  ☆15Updated 7 months ago
• OpenCausaLab / CELLO
  ☆21Updated last year
• qiuzh20 / RMoE
  Official implementation of RMoE (Layerwise Recurrent Router for Mixture-of-Experts)
  ☆28Updated last year
• ExplainableML / fomo_in_flux
  Code and benchmark for the paper: "A Practitioner's Guide to Continual Multimodal Pretraining" [NeurIPS'24]
  ☆61Updated last year
• AV-Odyssey / AV-Odyssey
  This repo contains evaluation code for the paper "AV-Odyssey: Can Your Multimodal LLMs Really Understand Audio-Visual Information?"
  ☆32Updated last year
• shulin16 / MMInA
  [ACL2025 Findings] Benchmarking Multihop Multimodal Internet Agents
  ☆47Updated 10 months ago
• mbzuai-oryx / Agent-X
  Evaluating Deep Multimodal Reasoning in Vision-Centric Agentic Tasks
  ☆34Updated last month
• si0wang / ViCrit
  ☆24Updated 7 months ago
• XinrunXu / DeepPHY
  DeepPHY: Benchmarking Agentic VLMs on Physical Reasoning
  ☆166Updated 2 months ago
• UCSC-VLAA / Sight-Beyond-Text
  [TMLR 2024] Official implementation of "Sight Beyond Text: Multi-Modal Training Enhances LLMs in Truthfulness and Ethics"
  ☆20Updated 2 years ago
• kokolerk / TON
  [NeurIPS 2025] Think or Not? Selective Reasoning via Reinforcement Learning for Vision-Language Models
  ☆53Updated 3 months ago
• kyegomez / Mirasol
  Pytorch Implementation of the Model from "MIRASOL3B: A MULTIMODAL AUTOREGRESSIVE MODEL FOR TIME-ALIGNED AND CONTEXTUAL MODALITIES"
  ☆26Updated 11 months ago
• lyan62 / vlm-info-loss
  ☆21Updated 4 months ago
• Shalev-Lifshitz / MultiAgentVerification
  Multi-Agent Verification: Scaling Test-Time Compute with Multiple Verifiers
  ☆26Updated 10 months ago
• OpenNLPLab / HGRN2
  HGRN2: Gated Linear RNNs with State Expansion
  ☆56Updated last year
• MikaStars39 / StableMask
  PyTorch implementation of StableMask (ICML'24)
  ☆15Updated last year
• MIO-Team / MIO
  MIO: A Foundation Model on Multimodal Tokens
  ☆32Updated last year
• shangshang-wang / Resa
  Resa: Transparent Reasoning Models via SAEs
  ☆47Updated 3 months ago
• ethanlshen / HierNet
  Code for "Are “Hierarchical” Visual Representations Hierarchical?" in NeurIPS Workshop for Symmetry and Geometry in Neural Representation…
  ☆22Updated 2 years ago
• shiqichen17 / AdaptVis
  Github repository for "Why Is Spatial Reasoning Hard for VLMs? An Attention Mechanism Perspective on Focus Areas" (ICML 2025)
  ☆68Updated 8 months ago
• sled-group / world-to-words
  Official Code for ACL 2023 Outstanding Paper: World-to-Words: Grounded Open Vocabulary Acquisition through Fast Mapping in Vision-Languag…
  ☆33Updated 2 years ago
• Yui010206 / CREMA
  [ICLR 2025] CREMA: Generalizable and Efficient Video-Language Reasoning via Multimodal Modular Fusion
  ☆55Updated 6 months ago
• UMass-Embodied-AGI / CoVLM
  [ICLR 2023] CoVLM: Composing Visual Entities and Relationships in Large Language Models Via Communicative Decoding
  ☆46Updated 7 months ago
• locuslab / llava-token-compression
  ☆46Updated last year
• pliang279 / HEMM
  Holistic evaluation of multimodal foundation models
  ☆49Updated last year
• YuxiXie / V-DPO
  Preference Learning for LLaVA
  ☆58Updated last year