This is the official repository for paper: cross-modal information flow in multimodal large language models
☆44May 21, 2025Updated last year
Alternatives and similar repositories for cross-modal-information-flow-in-MLLM
Users that are interested in cross-modal-information-flow-in-MLLM are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- [ECCV2024]FALIP: Visual Prompt as Foveal Attention Boosts CLIP Zero-Shot Performance☆18Sep 11, 2024Updated last year
- [ACL 2026 Main] Revisit What You See: Revealing Visual Semantics in Vision Tokens to Guide LVLM Decoding☆26Nov 21, 2025Updated 8 months ago
- [CVPR 2025] Devils in Middle Layers of Large Vision-Language Models: Interpreting, Detecting and Mitigating Object Hallucinations via Att…☆84Oct 9, 2025Updated 9 months ago
- Official code for **Prune Redundancy, Preserve Essence: Vision Token Compression in VLMs via Synergistic Importance-Diversity** (PruneSI…☆13Mar 25, 2026Updated 4 months ago
- Official Pytorch implementation of MuCo: Multi-turn Contrastive Learning for Multimodal Embedding Model (CVPR 2026)☆15Apr 16, 2026Updated 3 months ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Interpreting CLIP with Hierarchical Sparse Autoencoders (ICML 2025)☆28Jan 17, 2026Updated 6 months ago
- [NeurIPS 2025 🔥] Official implementation for "Don't Just Chase “Highlighted Tokens” in MLLMs: Revisiting Visual Holistic Context Retenti…☆66Mar 5, 2026Updated 4 months ago
- Code for paper: "What’s in the Image? A Deep-Dive into the Vision of Vision Language Models" (CVPR 2025)☆18May 1, 2025Updated last year
- [ICCV 2025] ONLY: One-Layer Intervention Sufficiently Mitigates Hallucinations in Large Vision-Language Models☆51Jul 7, 2025Updated last year
- Code for paper: Visual Signal Enhancement for Object Hallucination Mitigation in Multimodal Large language Models☆61Dec 18, 2024Updated last year
- [CVPR2026] Official codebase for the paper "Reasoning Within the Mind: Dynamic Multimodal Interleaving in Latent Space"☆85May 12, 2026Updated 2 months ago
- [NeurIPS 2024] "Self-Calibrated Tuning of Vision-Language Models for Out-of-Distribution Detection"☆13Oct 28, 2024Updated last year
- Code and datasets for "What’s “up” with vision-language models? Investigating their struggle with spatial reasoning".☆71Feb 28, 2024Updated 2 years ago
- ☆28Feb 14, 2025Updated last year
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- [ICLR 2025] Code for Self-Correcting Decoding with Generative Feedback for Mitigating Hallucinations in Large Vision-Language Models☆26Apr 14, 2025Updated last year
- Latest Advances on Modality Priors in Multimodal Large Language Models☆30Dec 10, 2025Updated 7 months ago
- [ICLR 2025] BlueSuffix: Reinforced Blue Teaming for Vision-Language Models Against Jailbreak Attacks☆31Nov 2, 2025Updated 8 months ago
- ☆16Jun 14, 2025Updated last year
- Code for ICLR 2025 Paper: Visual Description Grounding Reduces Hallucinations and Boosts Reasoning in LVLMs☆25May 7, 2025Updated last year
- ☆25Mar 18, 2025Updated last year
- The paper list of multilingual pre-trained models (Continual Updated).☆25Jun 18, 2024Updated 2 years ago
- Code for Reducing Hallucinations in Vision-Language Models via Latent Space Steering☆117Nov 23, 2024Updated last year
- [CVPR 2025] Mitigating Object Hallucinations in Large Vision-Language Models with Assembly of Global and Local Attention☆68Jul 16, 2024Updated 2 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Official codebase for the paper Latent Visual Reasoning☆171Oct 22, 2025Updated 9 months ago
- Official code for paper "Reasoning Fails Where Step Flow Breaks" (ACL 2026)☆18Apr 19, 2026Updated 3 months ago
- Code for Retrieval-Augmented Perception （ICML 2025)☆74Apr 22, 2026Updated 3 months ago
- ☆31Nov 17, 2024Updated last year
- [ECCV 2024] 4D Contrastive Superflows are Dense 3D Representation Learners☆52Dec 4, 2025Updated 7 months ago
- [CVPR 2025] Hybrid Global-Local Representation with Augmented Spatial Guidance for Zero-Shot Referring Image Segmentation☆37Jun 27, 2025Updated last year
- [ICLR 2025] PyTorch Implementation of "ETA: Evaluating Then Aligning Safety of Vision Language Models at Inference Time"☆34Jul 20, 2025Updated last year
- ☆32Oct 23, 2024Updated last year
- A detection/segmentation dataset with labels characterized by intricate and flexible expressions. "Described Object Detection: Liberating…☆138Mar 20, 2024Updated 2 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Official Codes for Fine-Grained Visual Prompting, NeurIPS 2023☆57Feb 1, 2024Updated 2 years ago
- [ICML 2024] Official implementation for "HALC: Object Hallucination Reduction via Adaptive Focal-Contrast Decoding"☆115Dec 4, 2024Updated last year
- ☆14Apr 10, 2025Updated last year
- Compress conventional Vision-Language Pre-training data☆52Sep 22, 2023Updated 2 years ago
- ☆13Jul 1, 2024Updated 2 years ago
- [ECCV 2024] Official PyTorch implementation of LUT "Learning with Unmasked Tokens Drives Stronger Vision Learners"☆14Dec 1, 2024Updated last year
- ☆13Oct 25, 2024Updated last year