Alternatives and similar repositories for cross-modal-information-flow-in-MLLM

Users that are interested in cross-modal-information-flow-in-MLLM are comparing it to the libraries listed below

• seilk / VisAttnSink
  [ICLR 2025] See What You Are Told: Visual Attention Sink in Large Multimodal Models
  ☆65Updated 8 months ago
• maifoundations / Visionary-R1
  Mitigating Shortcuts in Visual Reasoning with Reinforcement Learning
  ☆40Updated 3 months ago
• Lackel / AGLA
  [CVPR 2025] Mitigating Object Hallucinations in Large Vision-Language Models with Assembly of Global and Local Attention
  ☆49Updated last year
• wusize / F-LMM
  [CVPR2025] Code Release of F-LMM: Grounding Frozen Large Multimodal Models
  ☆104Updated 5 months ago
• xing0047 / cca-llava
  [NeurIPS 2024] Mitigating Object Hallucination via Concentric Causal Attention
  ☆63Updated 2 months ago
• ncTimTang / AKS
  [CVPR 2025] Adaptive Keyframe Sampling for Long Video Understanding
  ☆120Updated 2 months ago
• mrwu-mac / ControlMLLM
  [NeurIPS2024] Repo for the paper `ControlMLLM: Training-Free Visual Prompt Learning for Multimodal Large Language Models'
  ☆195Updated 3 months ago
• JieShibo / MemVP
  [ICML 2024] Memory-Space Visual Prompting for Efficient Vision-Language Fine-Tuning
  ☆50Updated last year
• yaolinli / DeCo
  Code for DeCo: Decoupling token compression from semanchc abstraction in multimodal large language models
  ☆74Updated 3 months ago
• leaves162 / CLIPtrase
  cliptrase
  ☆46Updated last year
• heliossun / SQ-LLaVA
  Visual self-questioning for large vision-language assistant.
  ☆45Updated 3 months ago
• DreamMr / RAP
  Code for Retrieval-Augmented Perception （ICML 2025)
  ☆59Updated 2 months ago
• mbzuai-oryx / VideoGLaMM
  [CVPR 2025 🔥]A Large Multimodal Model for Pixel-Level Visual Grounding in Videos
  ☆87Updated 6 months ago
• meetdavidwan / crg
  PyTorch code for "Contrastive Region Guidance: Improving Grounding in Vision-Language Models without Training"
  ☆37Updated last year
• OpenGVLab / TimeSuite
  [ICLR 2025] TimeSuite: Improving MLLMs for Long Video Understanding via Grounded Tuning
  ☆46Updated 6 months ago
• LaVi-Lab / AIM
  [ICCV 2025] Official code for "AIM: Adaptive Inference of Multi-Modal LLMs via Token Merging and Pruning"
  ☆42Updated 3 weeks ago
• seilk / LocalizationHeads
  [CVPR 2025 Highlight] Your Large Vision-Language Model Only Needs A Few Attention Heads For Visual Grounding
  ☆43Updated 2 months ago
• minglllli / CLS-RL
  [NeurIPS 2025 Spotlight] Think or Not Think: A Study of Explicit Thinking in Rule-Based Visual Reinforcement Fine-Tuning
  ☆69Updated last month
• yu-rp / apiprompting
  [ECCV 2024] API: Attention Prompting on Image for Large Vision-Language Models
  ☆104Updated last year
• xmed-lab / TAM
  [ICCV25 Oral] Token Activation Map to Visually Explain Multimodal LLMs
  ☆107Updated 2 months ago
• lezhang7 / SAIL
  [CVPR 2025 Highlight] Official Pytorch codebase for paper: "Assessing and Learning Alignment of Unimodal Vision and Language Models"
  ☆50Updated 2 months ago
• Paranioar / UniPT
  [CVPR2024] The code of "UniPT: Universal Parallel Tuning for Transfer Learning with Efficient Parameter and Memory"
  ☆67Updated last year
• mbzuai-oryx / CVRR-Evaluation-Suite
  [CVPRW-25 MMFM] Official repository of paper titled "How Good is my Video LMM? Complex Video Reasoning and Robustness Evaluation Suite fo…
  ☆50Updated last year
• Sreyan88 / VDGD
  Code for ICLR 2025 Paper: Visual Description Grounding Reduces Hallucinations and Boosts Reasoning in LVLMs
  ☆21Updated 5 months ago
• MME-Benchmarks / MME-RealWorld
  ✨✨ [ICLR 2025] MME-RealWorld: Could Your Multimodal LLM Challenge High-Resolution Real-World Scenarios that are Difficult for Humans?
  ☆135Updated last week
• yuecao0119 / MMFuser
  The official implementation of the paper "MMFuser: Multimodal Multi-Layer Feature Fuser for Fine-Grained Vision-Language Understanding". …
  ☆59Updated 11 months ago
• wuw2019 / LoTLIP
  [NeurIPS 2024] Official PyTorch implementation of LoTLIP: Improving Language-Image Pre-training for Long Text Understanding
  ☆45Updated 9 months ago
• zjr2000 / REVERIE
  [ECCV2024] Reflective Instruction Tuning: Mitigating Hallucinations in Large Vision-Language Models
  ☆19Updated last year
• LALBJ / PAI
  [ECCV 2024] Paying More Attention to Image: A Training-Free Method for Alleviating Hallucination in LVLMs
  ☆147Updated 11 months ago
• ys-zong / VL-ICL
  [ICLR 2025] VL-ICL Bench: The Devil in the Details of Multimodal In-Context Learning
  ☆65Updated last month