Alternatives and similar repositories for multimodal_alignment

Users that are interested in multimodal_alignment are comparing it to the libraries listed below

• tianyi-lab / R2-T2
  [ICML 2025] Code for "R2-T2: Re-Routing in Test-Time for Multimodal Mixture-of-Experts"
  ☆15Updated 5 months ago
• g-luo / vlm_cross_modal_reps
  Official PyTorch Implementation for Vision-Language Models Create Cross-Modal Task Representations, ICML 2025
  ☆30Updated 4 months ago
• microsoft / x-reasoner
  X-Reasoner: Towards Generalizable Reasoning Across Modalities and Domains
  ☆47Updated 3 months ago
• ExplainableML / sae-for-vlm
  Sparse Autoencoders Learn Monosemantic Features in Vision-Language Models
  ☆32Updated 4 months ago
• ExplainableML / fomo_in_flux
  Code and benchmark for the paper: "A Practitioner's Guide to Continual Multimodal Pretraining" [NeurIPS'24]
  ☆57Updated 8 months ago
• OpenCausaLab / CELLO
  ☆21Updated 9 months ago
• OpenNLPLab / HGRN2
  HGRN2: Gated Linear RNNs with State Expansion
  ☆54Updated last year
• kokolerk / TON
  Think or Not? Selective Reasoning via Reinforcement Learning for Vision-Language Models
  ☆40Updated 2 weeks ago
• UCSC-VLAA / Sight-Beyond-Text
  [TMLR 2024] Official implementation of "Sight Beyond Text: Multi-Modal Training Enhances LLMs in Truthfulness and Ethics"
  ☆20Updated last year
• ALT-JS / OthelloSAE
  CS194-196 Course Project
  ☆15Updated 6 months ago
• si0wang / ViCrit
  ☆23Updated 2 months ago
• princeton-pli / VLM_S2H
  Generalizing from SIMPLE to HARD Visual Reasoning: Can We Mitigate Modality Imbalance in VLMs?
  ☆14Updated 2 months ago
• jmhb0 / microvqa
  [CVPR 2025] MicroVQA eval and 🤖RefineBot code for "MicroVQA: A Multimodal Reasoning Benchmark for Microscopy-Based Scientific Research"…
  ☆23Updated last month
• AV-Odyssey / AV-Odyssey
  This repo contains evaluation code for the paper "AV-Odyssey: Can Your Multimodal LLMs Really Understand Audio-Visual Information?"
  ☆28Updated 8 months ago
• kigb / DropoutDecoding
  ☆18Updated 8 months ago
• XinrunXu / DeepPHY
  DeepPHY: Benchmarking Agentic VLMs on Physical Reasoning
  ☆144Updated last week
• wmn-231314 / diffusion-data-constraint
  Official PyTorch implementation and models for paper "Diffusion Beats Autoregressive in Data-Constrained Settings". We find diffusion mod…
  ☆86Updated this week
• Yui010206 / CREMA
  [ICLR 2025] CREMA: Generalizable and Efficient Video-Language Reasoning via Multimodal Modular Fusion
  ☆49Updated 2 months ago
• ZhentingWang / DUMP
  ☆24Updated 3 months ago
• DAMO-NLP-SG / LLM-Multilingual-Knowledge-Boundaries
  [ACL 2025] Analyzing LLMs' Multilingual Knowledge Boundary Cognition Across Languages Through the Lens of Internal Representations
  ☆13Updated 2 months ago
• WangFei-2019 / SNARE
  Project for SNARE benchmark
  ☆11Updated last year
• Gabesarch / ICAL
  ☆48Updated 3 months ago
• aszala / EnvGen
  Official Code Repository for EnvGen: Generating and Adapting Environments via LLMs for Training Embodied Agents (COLM 2024)
  ☆35Updated last year
• qiuzh20 / RMoE
  Official implementation of RMoE (Layerwise Recurrent Router for Mixture-of-Experts)
  ☆22Updated last year
• shenao-zhang / BARL
  Bayes-Adaptive RL for LLM Reasoning
  ☆37Updated 3 months ago
• HelmholtzAI-FZJ / flex_gen
  ☆18Updated 7 months ago
• shiqichen17 / AdaptVis
  Github repository for "Why Is Spatial Reasoning Hard for VLMs? An Attention Mechanism Perspective on Focus Areas" (ICML 2025)
  ☆42Updated 3 months ago
• lapisrocks / DiscreteAdversarialDistillation
  [NeurIPS 2023] Official repository for "Distilling Out-of-Distribution Robustness from Vision-Language Foundation Models"
  ☆12Updated last year
• waltonfuture / MM-UPT
  Unsupervised GRPO
  ☆46Updated 2 months ago
• ethanlshen / HierNet
  Code for "Are “Hierarchical” Visual Representations Hierarchical?" in NeurIPS Workshop for Symmetry and Geometry in Neural Representation…
  ☆21Updated last year