A curated collection of resources focused on the Mechanistic Interpretability (MI) of Large Multimodal Models (LMMs). This repository aggregates surveys, blog posts, and research papers that explore how LMMs represent, transform, and align multimodal information internally.
☆223Mar 4, 2026Updated 8 months ago
Alternatives and similar repositories for Awesome-LMMs-Mechanistic-Interpretability
Users that are interested in Awesome-LMMs-Mechanistic-Interpretability are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- awesome SAE papers☆81May 24, 2025Updated last year
- ☆37Jun 13, 2025Updated last year
- [EMNLP 2025 Oral] 🎉 Shallow Focus, Deep Fixes: Enhancing Shallow Layers Vision Attention Sinks to Alleviate Hallucination in LVLMs☆14Dec 10, 2025Updated 10 months ago
- ☆274Nov 22, 2024Updated last year
- awesome papers in LLM interpretability☆628Aug 20, 2025Updated last year
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- ☆15Jan 20, 2026Updated 9 months ago
- code for EMNLP 2024 paper: Neuron-Level Knowledge Attribution in Large Language Models☆52Nov 17, 2024Updated last year
- [ICCV 2025] Auto Interpretation Pipeline and many other functionalities for Multimodal SAE Analysis.☆203Sep 26, 2025Updated last year
- A curated list of resources for activation engineering☆140Oct 2, 2025Updated last year
- [ICLR 2026] Official implementation of the paper "Map the Flow: Revealing Hidden Pathways of Information in VideoLLMs"☆26Mar 3, 2026Updated 8 months ago
- Training Sparse Autoencoders on Language Models☆1,581Updated this week
- Less is More: Mitigating Multimodal Hallucination from an EOS Decision Perspective (ACL 2024)☆59Oct 28, 2024Updated 2 years ago
- [ACL 2025] "CoT-UQ: Improving Response-wise Uncertainty Quantification in LLMs with Chain-of-Thought"☆17Apr 3, 2025Updated last year
- An awesome repository & A comprehensive survey on interpretability of LLM attention heads.☆414Mar 2, 2025Updated last year
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- [ICML'25] Our study systematically investigates massive values in LLMs' attention mechanisms. First, we observe massive values are concen…☆87Jun 20, 2025Updated last year
- Sparse autoencoders for vision☆69Sep 25, 2026Updated last month
- A curated list of LLM Interpretability related material - Tutorial, Library, Survey, Paper, Blog, etc..☆308Jan 22, 2026Updated 9 months ago
- FeatureAlignment = Alignment + Mechanistic Interpretability☆35Mar 8, 2025Updated last year
- [ICCV25 Oral] Token Activation Map to Visually Explain Multimodal LLMs☆191Dec 14, 2025Updated 10 months ago
- [NeurIPS 2025] Official Implementation of paper "Sherlock: Self-Correcting Reasoning in Vision-Language Models"☆31Jun 4, 2026Updated 5 months ago
- ☆88Nov 5, 2024Updated 2 years ago
- PyTorch implementation of UniKE☆11Apr 16, 2026Updated 6 months ago
- A library for mechanistic interpretability of GPT-style language models☆4,051Updated this week
- End-to-end encrypted cloud storage - Proton Drive • AdSpecial offer: 40% Off Yearly / 80% Off First Month. Protect your most important files, photos, and documents from prying eyes.
- [NeurIPS'26] In this work, we investigate how Large Language Models (LLMs) adapt their internal representations when encountering inputs …☆29Oct 23, 2026Updated 2 weeks ago
- A very hacky set of functions for getting plotly to do what I want when doing mech interp research, designed to be compatible with PyTorc…☆16Jun 16, 2023Updated 3 years ago
- The Github repo for our survey paper: "Locate, Steer, and Improve: A Practical Survey of Actionable Mechanistic Interpretability in Large…☆162Apr 15, 2026Updated 6 months ago
- [NAACL 2025 Oral] From redundancy to relevance: Enhancing explainability in multimodal large language models☆130Jan 30, 2026Updated 9 months ago
- A library of visualization tools for the interpretability and hallucination analysis of large vision-language models (LVLMs).☆43May 22, 2025Updated last year
- A framework that allows you to apply Sparse AutoEncoder on any models☆53Jul 11, 2025Updated last year
- A carefully curated collection of high-quality libraries, projects, tutorials, research papers, and other essential resources focused on …☆172Updated this week
- A versatile toolkit for applying Logit Lens to modern large language models (LLMs). Currently supports Llama-3.1-8B and Qwen-2.5-7B, enab…☆179Aug 14, 2025Updated last year
- ☆12Jan 13, 2026Updated 9 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Collection of Reverse Engineering in Large Model☆35Jan 8, 2025Updated last year
- [ACL 2025] Data and Code for Paper VLSBench: Unveiling Visual Leakage in Multimodal Safety☆62Jul 21, 2025Updated last year
- [CVPR 2025] Mitigating Object Hallucinations in Large Vision-Language Models with Assembly of Global and Local Attention☆71Jul 16, 2024Updated 2 years ago
- ViT Prisma is a mechanistic interpretability library for Vision and Video Transformers (ViTs).☆398Oct 7, 2026Updated last month
- The official repo for "Where do Large Vision-Language Models Look at when Answering Questions?"☆74Jan 7, 2026Updated 10 months ago
- A repository for awesome resources in mechanistic interpretability☆17Jan 18, 2023Updated 3 years ago
- 关于LLM和Multimodal LLM的paper list☆65Aug 20, 2026Updated 2 months ago