Alternatives and similar repositories for multimodal-sae:

Users that are interested in multimodal-sae are comparing it to the libraries listed below

• AtsuMiyai / UPD
  Unsolvable Problem Detection: Evaluating Trustworthiness of Vision Language Models
  ☆75Updated 7 months ago
• orrzohar / Video-STaR
  [ICLR 2025] Video-STaR: Self-Training Enables Video Instruction Tuning with Any Supervision
  ☆60Updated 9 months ago
• EvolvingLMMs-Lab / multimodal-search-r1
  ☆84Updated 2 weeks ago
• Yangyi-Chen / SOLO
  [TMLR] Public code repo for paper "A Single Transformer for Scalable Vision-Language Modeling"
  ☆132Updated 5 months ago
• nickjiang2378 / vl-interp
  Official Pytorch implementation of "Interpreting and Editing Vision-Language Representations to Mitigate Hallucinations" (ICLR '25)
  ☆67Updated last month
• multimodal-interpretability / maia
  Official implementation of MAIA, A Multimodal Automated Interpretability Agent
  ☆78Updated last month
• Yushi-Hu / VisualSketchpad
  Codes for Visual Sketchpad: Sketching as a Visual Chain of Thought for Multimodal Language Models
  ☆199Updated 5 months ago
• yihedeng9 / STIC
  Enhancing Large Vision Language Models with Self-Training on Image Comprehension.
  ☆65Updated 10 months ago
• yihedeng9 / OpenVLThinker
  OpenVLThinker: An Early Exploration to Vision-Language Reasoning via Iterative Self-Improvement
  ☆71Updated 3 weeks ago
• dllm-reasoning / d1
  Official Implementation for the paper "d1: Scaling Reasoning in Diffusion Large Language Models via Reinforcement Learning"
  ☆77Updated last week
• si0wang / ThinkLite-VL
  ☆23Updated last week
• chenllliang / DnD-Transformer
  [ICLR 2025] Source code for paper "A Spark of Vision-Language Intelligence: 2-Dimensional Autoregressive Transformer for Efficient Finegr…
  ☆75Updated 4 months ago
• HKUNLP / diffusion-of-thoughts
  [NeurIPS 2024] Code for the paper "Diffusion of Thoughts: Chain-of-Thought Reasoning in Diffusion Language Models"
  ☆144Updated last month
• JieyuZ2 / TaskMeAnything
  [NeurIPS 2024] A task generation and model evaluation system for multimodal language models.
  ☆70Updated 4 months ago
• tulip-berkeley / open_clip
  An open source implementation of CLIP (With TULIP Support)
  ☆132Updated last month
• clemneo / llava-interp
  ☆53Updated 5 months ago
• zeyofu / BLINK_Benchmark
  This repo contains evaluation code for the paper "BLINK: Multimodal Large Language Models Can See but Not Perceive". https://arxiv.or…
  ☆121Updated 9 months ago
• RifleZhang / LLaVA-Reasoner-DPO
  ☆73Updated 3 months ago
• UCSC-VLAA / VLAA-Thinking
  SFT or RL? An Early Investigation into Training R1-Like Reasoning Large Vision-Language Models
  ☆92Updated this week
• TIGER-AI-Lab / VL-Rethinker
  The official code of "VL-Rethinker: Incentivizing Self-Reflection of Vision-Language Models with Reinforcement Learning"
  ☆61Updated this week
• haonan3 / AnchorContext
  AnchorAttention: Improved attention for LLMs long-context training
  ☆206Updated 3 months ago
• lucidrains / coconut-pytorch
  Implementation of 🥥 Coconut, Chain of Continuous Thought, in Pytorch
  ☆164Updated 3 months ago
• gstoica27 / KnOTS
  Model Merging with SVD to Tie the KnOTS [ICLR 2025]
  ☆51Updated 3 weeks ago
• Dongping-Chen / MLLM-Judge
  [ICML 2024 Oral] Official code repository for MLLM-as-a-Judge.
  ☆67Updated 2 months ago
• EvolvingLMMs-Lab / VideoMMMU
  ☆40Updated 2 weeks ago
• beichenzbc / BoostStep
  official code for "BoostStep: Boosting mathematical capability of Large Language Models via improved single-step reasoning"
  ☆35Updated 3 months ago
• hychaochao / EMMA
  The official repository for the paper "Can MLLMs Reason in Multimodality? EMMA: An Enhanced MultiModal ReAsoning Benchmark"
  ☆51Updated this week
• dongyh20 / Insight-V
  [CVPR2025 Highlight] Insight-V: Exploring Long-Chain Visual Reasoning with Multimodal Large Language Models
  ☆184Updated 3 weeks ago
• PRIME-RL / TTRL
  TTRL: Test-Time Reinforcement Learning
  ☆166Updated this week
• MingLiiii / Layer_Gradient
  What Happened in LLMs Layers when Trained for Fast vs. Slow Thinking: A Gradient Perspective
  ☆63Updated last month