Z1zs / MMNeuron
Official implementation of "MMNeuron: Discovering Neuron-Level Domain-Specific Interpretation in Multimodal Large Language Model". Our codes are borrowed from Tang's language specific neurons implementation and nrimsky's logit lens implementation.
☆16Updated 4 months ago
Alternatives and similar repositories for MMNeuron:
Users that are interested in MMNeuron are comparing it to the libraries listed below
- [CVPR' 25] Interleaved-Modal Chain-of-Thought☆12Updated 3 weeks ago
- Code and data for "Timo: Towards Better Temporal Reasoning for Language Models" (COLM 2024)☆21Updated 5 months ago
- Official implementation of paper 'Look Twice Before You Answer: Memory-Space Visual Retracing for Hallucination Mitigation in Multimodal …☆47Updated last month
- [EMNLP 2024] mDPO: Conditional Preference Optimization for Multimodal Large Language Models.☆71Updated 5 months ago
- [ICLR 2025] MLLM can see? Dynamic Correction Decoding for Hallucination Mitigation☆54Updated 4 months ago
- Official repo for "AlignGPT: Multi-modal Large Language Models with Adaptive Alignment Capability"☆32Updated 9 months ago
- MoCLE (First MLLM with MoE for instruction customization and generalization!) (https://arxiv.org/abs/2312.12379)☆35Updated last year
- [ICLR 2025] Mitigating Modality Prior-Induced Hallucinations in Multimodal Large Language Models via Deciphering Attention Causality☆21Updated last week
- [ICML 2024] Unveiling and Harnessing Hidden Attention Sinks: Enhancing Large Language Models without Training through Attention Calibrati…☆36Updated 9 months ago
- Code for Reducing Hallucinations in Vision-Language Models via Latent Space Steering☆49Updated 4 months ago
- M-STAR (Multimodal Self-Evolving TrAining for Reasoning) Project. Diving into Self-Evolving Training for Multimodal Reasoning☆56Updated 3 months ago
- ☆71Updated 10 months ago
- the official repo for EMNLP 2024 (main) paper "EFUF: Efficient Fine-grained Unlearning Framework for Mitigating Hallucinations in Multimo…☆19Updated last week
- This repository contains the code for SFT, RLHF, and DPO, designed for vision-based LLMs, including the LLaVA models and the LLaMA-3.2-vi…☆105Updated 6 months ago
- A Survey on the Honesty of Large Language Models☆57Updated 4 months ago
- ☆34Updated last month
- MMoE: Multimodal Mixture-of-Experts (EMNLP 2024)☆11Updated 5 months ago
- ☆73Updated 3 weeks ago
- Less is More: Mitigating Multimodal Hallucination from an EOS Decision Perspective (ACL 2024)☆46Updated 5 months ago
- Official Code Repository for the paper "Knowledge-Augmented Reasoning Distillation for Small Language Models in Knowledge-intensive Tasks…☆37Updated 4 months ago
- ☆41Updated last week
- Multimodal Instruction Tuning with Conditional Mixture of LoRA (ACL 2024)☆18Updated 8 months ago
- The official code repository for PRMBench.☆72Updated 2 months ago
- [ICLR 2025] The official pytorch implement of "Dynamic-LLaVA: Efficient Multimodal Large Language Models via Dynamic Vision-language Cont…☆29Updated 4 months ago
- codes for Efficient Test-Time Scaling via Self-Calibration☆13Updated last month
- code for ACL24 "MELoRA: Mini-Ensemble Low-Rank Adapter for Parameter-Efficient Fine-Tuning"☆19Updated 2 months ago
- A Self-Training Framework for Vision-Language Reasoning☆76Updated 2 months ago
- Code and data for "Living in the Moment: Can Large Language Models Grasp Co-Temporal Reasoning?" (ACL 2024)☆32Updated 9 months ago
- Latest Advances on Modality Priors in Multimodal Large Language Models☆13Updated 2 weeks ago
- The official repository for the paper "Can MLLMs Reason in Multimodality? EMMA: An Enhanced MultiModal ReAsoning Benchmark"☆50Updated this week