[ICLR 2025] See What You Are Told: Visual Attention Sink in Large Multimodal Models
☆119Feb 16, 2025Updated last year
Alternatives and similar repositories for VisAttnSink
Users that are interested in VisAttnSink are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- [CVPR 2025 Highlight] Your Large Vision-Language Model Only Needs A Few Attention Heads For Visual Grounding☆86Aug 31, 2025Updated last year
- [CVPR 2025] Official Pytorch Code for Spatial Transport Optimization by Repositioning Attention Map for Training-Free Text-to-Image Synth…☆15Jun 21, 2025Updated last year
- [ICLR'25] Official code for the paper 'MLLMs Know Where to Look: Training-free Perception of Small Visual Details with Multimodal LLMs'☆393Apr 20, 2025Updated last year
- [CVPR 2025] Your Large Vision-Language Model Only Needs A Few Attention Heads For Visual Grounding☆19Oct 4, 2025Updated last year
- [CVPR 2025] Mitigating Object Hallucinations in Large Vision-Language Models with Assembly of Global and Local Attention☆71Jul 16, 2024Updated 2 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- [WACV 2025 ORAL] Official Pytorch Code for DragText: Rethinking Text Embedding in Point-based Image Editing☆14Jan 22, 2025Updated last year
- [ICML 2024] Unveiling and Harnessing Hidden Attention Sinks: Enhancing Large Language Models without Training through Attention Calibrati…☆45Jun 30, 2024Updated 2 years ago
- [CVPR 2025] Devils in Middle Layers of Large Vision-Language Models: Interpreting, Detecting and Mitigating Object Hallucinations via Att…☆84Oct 9, 2025Updated last year
- [NeurIPS 2025] Official code for paper: Beyond Attention or Similarity: Maximizing Conditional Diversity for Token Pruning in MLLMs.☆110Sep 20, 2025Updated last year
- [NeurIPS2024] Official code for (IMA) Implicit Multimodal Alignment: On the Generalization of Frozen LLMs to Multimodal Inputs☆23Oct 15, 2024Updated 2 years ago
- Code for ICLR 2025 Paper: Visual Description Grounding Reduces Hallucinations and Boosts Reasoning in LVLMs☆25May 7, 2025Updated last year
- [ICLR 2025] When Attention Sink Emerges in Language Models: An Empirical View (Spotlight)☆164Jul 8, 2025Updated last year
- [ICCV 2025] ONLY: One-Layer Intervention Sufficiently Mitigates Hallucinations in Large Vision-Language Models☆53Jul 7, 2025Updated last year
- [ICCV25 Oral] Token Activation Map to Visually Explain Multimodal LLMs☆191Dec 14, 2025Updated 10 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- up-to-date curated list of state-of-the-art Large vision language models hallucinations research work, papers & resources☆332Aug 28, 2026Updated last month
- [ACL 2025] Cracking the Code of Hallucination in LVLMs with Vision-aware Head Divergence☆20Jun 10, 2025Updated last year
- ☆87Nov 5, 2024Updated last year
- Code for paper: Visual Signal Enhancement for Object Hallucination Mitigation in Multimodal Large language Models☆62Dec 18, 2024Updated last year
- [CVPR 2025] Code for "Notes-guided MLLM Reasoning: Enhancing MLLM with Knowledge and Visual Notes for Visual Question Answering".☆27Jun 16, 2025Updated last year
- [ICML 2025] Official implementation of paper 'Look Twice Before You Answer: Memory-Space Visual Retracing for Hallucination Mitigation in…☆174Sep 25, 2025Updated last year
- [MICCAI 2024 Spotlight✨] Official Pytorch Code for Advancing Text-Driven Chest X-Ray Generation with Policy-Based Reinforcement Learning☆13Sep 4, 2024Updated 2 years ago
- Github repository for "Why Is Spatial Reasoning Hard for VLMs? An Attention Mechanism Perspective on Focus Areas" (ICML 2025)☆75May 2, 2025Updated last year
- [ECCV 2026] StAR: Segment Anything Reasoner☆26Apr 2, 2026Updated 6 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Visualizing the attention of vision-language models☆305Feb 28, 2025Updated last year
- [ICCV 2025] Official code for "AIM: Adaptive Inference of Multi-Modal LLMs via Token Merging and Pruning"☆65Oct 9, 2025Updated last year
- ☆21Apr 7, 2025Updated last year
- [ICLR 2025] MLLM can see? Dynamic Correction Decoding for Hallucination Mitigation☆148Sep 11, 2025Updated last year
- ☆23May 8, 2025Updated last year
- Code and data for paper "Exploring Hallucination of Large Multimodal Models in Video Understanding: Benchmark, Analysis and Mitigation".☆25Oct 22, 2025Updated 11 months ago
- [NAACL 2025 Oral] From redundancy to relevance: Enhancing explainability in multimodal large language models☆129Jan 30, 2026Updated 8 months ago
- Code for paper: Nullu: Mitigating Object Hallucinations in Large Vision-Language Models via HalluSpace Projection☆64Mar 13, 2025Updated last year
- Official implementation of "VIRAL: Visual Representation Alignment for MLLMs".☆167Sep 21, 2025Updated last year
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- H&E ROI-Level and WSI-Level Nuclei Segmentation with HoVer-Net☆10Jul 30, 2024Updated 2 years ago
- Code for paper: "What’s in the Image? A Deep-Dive into the Vision of Vision Language Models" (CVPR 2025)☆18May 1, 2025Updated last year
- [ACL-2026 Findings] Implementation for HiPrune, a training-free visual token pruning method for VLM acceleration.☆61Apr 29, 2026Updated 5 months ago
- ☆22Apr 5, 2024Updated 2 years ago
- Scaffold Prompting to promote LMMs☆46Dec 16, 2024Updated last year
- A framework that allows you to apply Sparse AutoEncoder on any models☆53Jul 11, 2025Updated last year
- [ICML 2026] Beyond Next-Token Alignment: Distilling Multimodal Large Language Models via Token Interactions☆25Feb 11, 2026Updated 8 months ago