Alternatives and similar repositories for multimodal_alignment

Users that are interested in multimodal_alignment are comparing it to the libraries listed below

• tianyi-lab / R2-T2
  [ICML 2025] Code for "R2-T2: Re-Routing in Test-Time for Multimodal Mixture-of-Experts"
  ☆15Updated 4 months ago
• g-luo / vlm_cross_modal_reps
  Official PyTorch Implementation for Vision-Language Models Create Cross-Modal Task Representations, ICML 2025
  ☆30Updated 3 months ago
• OpenCausaLab / CELLO
  ☆21Updated 9 months ago
• UCSC-VLAA / Sight-Beyond-Text
  [TMLR 2024] Official implementation of "Sight Beyond Text: Multi-Modal Training Enhances LLMs in Truthfulness and Ethics"
  ☆20Updated last year
• ExplainableML / fomo_in_flux
  Code and benchmark for the paper: "A Practitioner's Guide to Continual Multimodal Pretraining" [NeurIPS'24]
  ☆57Updated 7 months ago
• microsoft / x-reasoner
  X-Reasoner: Towards Generalizable Reasoning Across Modalities and Domains
  ☆47Updated 3 months ago
• WangFei-2019 / SNARE
  Project for SNARE benchmark
  ☆11Updated last year
• princeton-pli / VLM_S2H
  Generalizing from SIMPLE to HARD Visual Reasoning: Can We Mitigate Modality Imbalance in VLMs?
  ☆14Updated 2 months ago
• Optimization-AI / FastCLIP
  Distributed Optimization Infra for learning CLIP models
  ☆27Updated 10 months ago
• kokolerk / TON
  Think or Not? Selective Reasoning via Reinforcement Learning for Vision-Language Models
  ☆40Updated 3 weeks ago
• s-vco / s-vco
  Symmetrical Visual Contrastive Optimization: Aligning Vision-Language Models with Minimal Contrastive Images
  ☆12Updated 2 months ago
• pliang279 / HEMM
  Holistic evaluation of multimodal foundation models
  ☆48Updated 11 months ago
• jiaangli / VLCA
  Do Vision and Language Models Share Concepts? A Vector Space Alignment Study
  ☆16Updated 8 months ago
• si0wang / ViCrit
  ☆23Updated last month
• waltonfuture / MM-UPT
  Unsupervised GRPO
  ☆41Updated last month
• XinrunXu / DeepPHY
  DeepPHY: Benchmarking Agentic VLMs on Physical Reasoning
  ☆30Updated this week
• kigb / DropoutDecoding
  ☆17Updated 8 months ago
• Yui010206 / CREMA
  [ICLR 2025] CREMA: Generalizable and Efficient Video-Language Reasoning via Multimodal Modular Fusion
  ☆48Updated last month
• ExplainableML / sae-for-vlm
  Sparse Autoencoders Learn Monosemantic Features in Vision-Language Models
  ☆24Updated 3 months ago
• sail-sg / dice
  Official implementation of Bootstrapping Language Models via DPO Implicit Rewards
  ☆44Updated 3 months ago
• shenao-zhang / BARL
  Bayes-Adaptive RL for LLM Reasoning
  ☆36Updated 2 months ago
• OpenNLPLab / HGRN2
  HGRN2: Gated Linear RNNs with State Expansion
  ☆55Updated 11 months ago
• MikaStars39 / StableMask
  PyTorch implementation of StableMask (ICML'24)
  ☆13Updated last year
• qiuzh20 / RMoE
  Official implementation of RMoE (Layerwise Recurrent Router for Mixture-of-Experts)
  ☆22Updated last year
• pliang279 / HighMMT
  [TMLR 2022] High-Modality Multimodal Transformer
  ☆117Updated 9 months ago
• PKU-ML / non_neg
  Official Code for ICLR 2024 Paper: Non-negative Contrastive Learning
  ☆45Updated last year
• gautierdag / plancraft
  Plancraft is a minecraft environment and agent suite to test planning capabilities in LLMs
  ☆16Updated last month
• mshukor / eP-ALM
  [ICCV23] Official implementation of eP-ALM: Efficient Perceptual Augmentation of Language Models.
  ☆27Updated last year
• locuslab / llava-token-compression
  ☆43Updated 9 months ago
• MCR-PEFT / Ex-MCR
  ☆44Updated 2 months ago