Alternatives and similar repositories for multimodal-sae

Users that are interested in multimodal-sae are comparing it to the libraries listed below

• yuhui-zh15 / AutoConverter
  Official implementation of "Automated Generation of Challenging Multiple-Choice Questions for Vision Language Model Evaluation" (CVPR 202…
  ☆39Updated 6 months ago
• nickjiang2378 / vlm-hallucinations
  [ICLR '25] Official Pytorch implementation of "Interpreting and Editing Vision-Language Representations to Mitigate Hallucinations"
  ☆96Updated last week
• Yushi-Hu / VisualSketchpad
  Codes for Visual Sketchpad: Sketching as a Visual Chain of Thought for Multimodal Language Models
  ☆269Updated 4 months ago
• clemneo / llava-interp
  ☆76Updated last year
• TIGER-AI-Lab / VL-Rethinker
  The official code of "VL-Rethinker: Incentivizing Self-Reflection of Vision-Language Models with Reinforcement Learning" [NeurIPS25]
  ☆168Updated 6 months ago
• yihedeng9 / STIC
  Enhancing Large Vision Language Models with Self-Training on Image Comprehension.
  ☆70Updated last year
• orrzohar / Video-STaR
  [ICLR 2025] Video-STaR: Self-Training Enables Video Instruction Tuning with Any Supervision
  ☆71Updated last year
• Wang-ML-Lab / multimodal-needle-in-a-haystack
  [NAACL 2025 Oral] Multimodal Needle in a Haystack (MMNeedle): Benchmarking Long-Context Capability of Multimodal Large Language Models
  ☆50Updated 7 months ago
• Yangyi-Chen / SOLO
  [TMLR] Public code repo for paper "A Single Transformer for Scalable Vision-Language Modeling"
  ☆147Updated last year
• YiyangZhou / POVID
  [Arxiv] Aligning Modalities in Vision Large Language Models via Preference Fine-tuning
  ☆90Updated last year
• yihedeng9 / OpenVLThinker
  OpenVLThinker: An Early Exploration to Vision-Language Reasoning via Iterative Self-Improvement
  ☆122Updated 4 months ago
• mathllm / MATH-V
  [NeurIPS 2024] MATH-Vision dataset and code to measure multimodal mathematical reasoning capabilities.
  ☆126Updated 6 months ago
• yale-nlp / MMVU
  Data and Code for CVPR 2025 paper "MMVU: Measuring Expert-Level Multi-Discipline Video Understanding"
  ☆75Updated 9 months ago
• shiqichen17 / VLM_Merging
  Github repository for "Bring Reason to Vision: Understanding Perception and Reasoning through Model Merging" (ICML 2025)
  ☆86Updated 2 months ago
• SalesforceAIResearch / LATTE
  ☆68Updated 2 months ago
• declare-lab / LLM-PuzzleTest
  This repository is maintained to release dataset and models for multimodal puzzle reasoning.
  ☆112Updated 9 months ago
• bigai-nlco / LatentSeek
  Official Repository of LatentSeek
  ☆69Updated 6 months ago
• junyangwang0410 / AMBER
  An LLM-free Multi-dimensional Benchmark for Multi-modal Hallucination Evaluation
  ☆145Updated last year
• luka-group / vlm-knowledge-conflict
  Code for paper "Unraveling Cross-Modality Knowledge Conflicts in Large Vision-Language Models."
  ☆49Updated last year
• FreedomIntelligence / LongLLaVA
  LongLLaVA: Scaling Multi-modal LLMs to 1000 Images Efficiently via Hybrid Architecture
  ☆211Updated 11 months ago
• kokolerk / TON
  [NeurIPS 2025] Think or Not? Selective Reasoning via Reinforcement Learning for Vision-Language Models
  ☆51Updated 2 months ago
• callsys / GMPO
  Geometric-Mean Policy Optimization
  ☆95Updated 3 weeks ago
• AtsuMiyai / UPD
  [ACL2025] Unsolvable Problem Detection: Robust Understanding Evaluation for Large Multimodal Models
  ☆79Updated 6 months ago
• OSU-NLP-Group / saev
  Sparse autoencoders for vision
  ☆52Updated this week
• UCSC-VLAA / VLAA-Thinking
  [TMLR 25] SFT or RL? An Early Investigation into Training R1-Like Reasoning Large Vision-Language Models
  ☆144Updated 2 months ago
• YiyangZhou / CSR
  [NeurIPS 2024] Calibrated Self-Rewarding Vision Language Models
  ☆81Updated last month
• si0wang / ThinkLite-VL
  ☆105Updated 6 months ago
• bronyayang / Law_of_Vision_Representation_in_MLLMs
  [COLM'25] Official implementation of the Law of Vision Representation in MLLMs
  ☆171Updated 2 months ago
• zli12321 / Vision-SR1
  Reinforcement Learning of Vision Language Models with Self Visual Perception Reward
  ☆146Updated 2 months ago
• JieyuZ2 / TaskMeAnything
  [NeurIPS 2024] A task generation and model evaluation system for multimodal language models.
  ☆73Updated last year