Alternatives and similar repositories for multimodal_alignment

Users that are interested in multimodal_alignment are comparing it to the libraries listed below

• g-luo / vlm_cross_modal_reps
  Official PyTorch Implementation for Vision-Language Models Create Cross-Modal Task Representations, ICML 2025
  ☆27Updated 2 months ago
• tianyi-lab / R2-T2
  [ICML 2025] Code for "R2-T2: Re-Routing in Test-Time for Multimodal Mixture-of-Experts"
  ☆15Updated 4 months ago
• lapisrocks / DiscreteAdversarialDistillation
  [NeurIPS 2023] Official repository for "Distilling Out-of-Distribution Robustness from Vision-Language Foundation Models"
  ☆12Updated last year
• OpenCausaLab / CELLO
  ☆21Updated 8 months ago
• UCSC-VLAA / Sight-Beyond-Text
  [TMLR 2024] Official implementation of "Sight Beyond Text: Multi-Modal Training Enhances LLMs in Truthfulness and Ethics"
  ☆20Updated last year
• pliang279 / HEMM
  Holistic evaluation of multimodal foundation models
  ☆48Updated 11 months ago
• MCR-PEFT / Ex-MCR
  ☆45Updated last month
• microsoft / x-reasoner
  X-Reasoner: Towards Generalizable Reasoning Across Modalities and Domains
  ☆46Updated 2 months ago
• princeton-pli / VLM_S2H
  Generalizing from SIMPLE to HARD Visual Reasoning: Can We Mitigate Modality Imbalance in VLMs?
  ☆14Updated last month
• ExplainableML / fomo_in_flux
  Code and benchmark for the paper: "A Practitioner's Guide to Continual Multimodal Pretraining" [NeurIPS'24]
  ☆57Updated 7 months ago
• s-vco / s-vco
  Symmetrical Visual Contrastive Optimization: Aligning Vision-Language Models with Minimal Contrastive Images
  ☆12Updated last month
• locuslab / llava-token-compression
  ☆42Updated 8 months ago
• kyegomez / PaLM2-VAdapter
  Implementation of "PaLM2-VAdapter:" from the multi-modal model paper: "PaLM2-VAdapter: Progressively Aligned Language Model Makes a Stron…
  ☆16Updated 8 months ago
• ExplainableML / sae-for-vlm
  Sparse Autoencoders Learn Monosemantic Features in Vision-Language Models
  ☆24Updated 3 months ago
• jiaangli / VLCA
  Do Vision and Language Models Share Concepts? A Vector Space Alignment Study
  ☆15Updated 7 months ago
• passing2961 / DialogCC
  Official code and dataset for our NAACL 2024 paper: DialogCC: An Automated Pipeline for Creating High-Quality Multi-modal Dialogue Datase…
  ☆13Updated last year
• kokolerk / TON
  Think or Not? Selective Reasoning via Reinforcement Learning for Vision-Language Models
  ☆40Updated last month
• ethanlshen / HierNet
  Code for "Are “Hierarchical” Visual Representations Hierarchical?" in NeurIPS Workshop for Symmetry and Geometry in Neural Representation…
  ☆21Updated last year
• si0wang / ViCrit
  ☆18Updated last month
• kigb / DropoutDecoding
  ☆17Updated 7 months ago
• jmhb0 / microvqa
  [CVPR 2025] MicroVQA eval and 🤖RefineBot code for "MicroVQA: A Multimodal Reasoning Benchmark for Microscopy-Based Scientific Research"…
  ☆21Updated last week
• sled-group / world-to-words
  Official Code for ACL 2023 Outstanding Paper: World-to-Words: Grounded Open Vocabulary Acquisition through Fast Mapping in Vision-Languag…
  ☆32Updated last year
• Vinoground / Vinoground
  ☆11Updated 8 months ago
• Gabesarch / ICAL
  ☆46Updated 2 months ago
• Optimization-AI / FastCLIP
  Distributed Optimization Infra for learning CLIP models
  ☆26Updated 9 months ago
• shulin16 / MMInA
  Official implementation of the paper "MMInA: Benchmarking Multihop Multimodal Internet Agents"
  ☆46Updated 4 months ago
• Yui010206 / CREMA
  [ICLR 2025] CREMA: Generalizable and Efficient Video-Language Reasoning via Multimodal Modular Fusion
  ☆48Updated 2 weeks ago
• OpenNLPLab / HGRN2
  HGRN2: Gated Linear RNNs with State Expansion
  ☆55Updated 10 months ago
• shangshang-wang / Resa
  Resa: Transparent Reasoning Models via SAEs
  ☆39Updated last month
• thunlp / SparsingLaw
  The open-source materials for paper "Sparsing Law: Towards Large Language Models with Greater Activation Sparsity".
  ☆23Updated 8 months ago