[ICLR 2025] See What You Are Told: Visual Attention Sink in Large Multimodal Models
☆93Feb 16, 2025Updated last year
Alternatives and similar repositories for VisAttnSink
Users that are interested in VisAttnSink are comparing it to the libraries listed below
Sorting:
- [CVPR 2025 Highlight] Your Large Vision-Language Model Only Needs A Few Attention Heads For Visual Grounding☆62Aug 31, 2025Updated 6 months ago
- [ICML 2024] Unveiling and Harnessing Hidden Attention Sinks: Enhancing Large Language Models without Training through Attention Calibrati…☆45Jun 30, 2024Updated last year
- [ICCV 2025] Official code for "AIM: Adaptive Inference of Multi-Modal LLMs via Token Merging and Pruning"☆55Oct 9, 2025Updated 4 months ago
- [CVPR 2025] Mitigating Object Hallucinations in Large Vision-Language Models with Assembly of Global and Local Attention☆61Jul 16, 2024Updated last year
- [ICLR'25] Official code for the paper 'MLLMs Know Where to Look: Training-free Perception of Small Visual Details with Multimodal LLMs'☆346Apr 20, 2025Updated 10 months ago
- [CVPR 2025] PACT: Pruning and Clustering-Based Token Reduction for Faster Visual Language Models☆56Jan 30, 2026Updated last month
- [CVPR 2025] Your Large Vision-Language Model Only Needs A Few Attention Heads For Visual Grounding☆16Oct 4, 2025Updated 5 months ago
- ☆20Apr 15, 2025Updated 10 months ago
- [ICLR '25] Official Pytorch implementation of "Interpreting and Editing Vision-Language Representations to Mitigate Hallucinations"☆97Nov 30, 2025Updated 3 months ago
- [ICCV 2025] ONLY: One-Layer Intervention Sufficiently Mitigates Hallucinations in Large Vision-Language Models☆49Jul 7, 2025Updated 7 months ago
- [AAAI 2026] Global Compression Commander: Plug-and-Play Inference Acceleration for High-Resolution Large Vision-Language Models☆38Jan 27, 2026Updated last month
- ☆14Jan 16, 2024Updated 2 years ago
- [CVPR 2025] Devils in Middle Layers of Large Vision-Language Models: Interpreting, Detecting and Mitigating Object Hallucinations via Att…☆63Oct 9, 2025Updated 4 months ago
- [NeurIPS 2025] Sparse Autoencoders Learn Monosemantic Features in Vision-Language Models☆64Nov 27, 2025Updated 3 months ago
- Code for paper: Nullu: Mitigating Object Hallucinations in Large Vision-Language Models via HalluSpace Projection☆52Mar 13, 2025Updated 11 months ago
- MC-CoT implementation code☆22Jun 24, 2025Updated 8 months ago
- [ICLR 2025] MLLM can see? Dynamic Correction Decoding for Hallucination Mitigation☆136Sep 11, 2025Updated 5 months ago
- Official Implementation of CODE☆17Sep 26, 2024Updated last year
- MAM: ModularMulti-Agent Framework for Multi-Modal Medical Diagnosis via Role-Specialized Collaboration☆37Jun 25, 2025Updated 8 months ago
- Scaffold Prompting to promote LMMs☆46Dec 16, 2024Updated last year
- ☆21Nov 29, 2022Updated 3 years ago
- [NAACL 2025 Oral] From redundancy to relevance: Enhancing explainability in multimodal large language models☆129Jan 30, 2026Updated last month
- Research works from Tencent AI Lab regarding self-evolving agents☆82Jan 30, 2026Updated last month
- [ICML 2025] Official implementation of paper 'Look Twice Before You Answer: Memory-Space Visual Retracing for Hallucination Mitigation in…☆172Sep 25, 2025Updated 5 months ago
- Official implementation for the paper"Towards Understanding How Knowledge Evolves in Large Vision-Language Models"☆28Apr 10, 2025Updated 10 months ago
- Emergent Visual Grounding in Large Multimodal Models Without Grounding Supervision☆42Oct 19, 2025Updated 4 months ago
- Code release for paper EventCLIP: Adapting CLIP for Event-based Object Recognition☆23Nov 9, 2023Updated 2 years ago
- FireQ: Fast INT4-FP8 Kernel and RoPE-aware Quantization for LLM Inference Acceleration☆20Jun 27, 2025Updated 8 months ago
- spatio-temporal tasks☆16Jul 15, 2024Updated last year
- [NeurIPS 2023]DDCoT: Duty-Distinct Chain-of-Thought Prompting for Multimodal Reasoning in Language Models☆49Mar 18, 2024Updated last year
- [ICML2024] Repo for the paper `Evaluating and Analyzing Relationship Hallucinations in Large Vision-Language Models'☆22Jan 1, 2025Updated last year
- [CVPR 2025] Few-shot Recognition via Stage-Wise Retrieval-Augmented Finetuning☆29Jan 10, 2026Updated last month
- Implementation for HiPrune, a training-free visual token pruning method for VLM acceleration.☆46Oct 29, 2025Updated 4 months ago
- ☆26Nov 23, 2021Updated 4 years ago
- ☆21Jul 25, 2022Updated 3 years ago
- Official repository of the paper "A Glimpse to Compress: Dynamic Visual Token Pruning for Large Vision-Language Models"☆91Feb 13, 2026Updated 3 weeks ago
- MICCAI 22 accepted paper “TranSQ: Transformer-based Semantic Query for Medical Report Generation“ for medical report generation☆27Sep 3, 2025Updated 6 months ago
- STI-Bench : Are MLLMs Ready for Precise Spatial-Temporal World Understanding?☆38Jan 12, 2026Updated last month
- Project Page for GaussianFormer☆24May 30, 2024Updated last year