EIT-NLP / Layer_Select_Fuse_for_MLLM
[CVPR2025] Official implementation of the paper "Multi-Layer Visual Feature Fusion in Multimodal LLMs: Methods, Analysis, and Best Practices". (by Junyan Lin)
☆15Updated last month
Alternatives and similar repositories for Layer_Select_Fuse_for_MLLM:
Users that are interested in Layer_Select_Fuse_for_MLLM are comparing it to the libraries listed below
- [LLaVA-Video-R1]✨First Adaptation of R1 to LLaVA-Video (2025-03-18)☆27Updated last month
- [NeurIPS2024] Repo for the paper `ControlMLLM: Training-Free Visual Prompt Learning for Multimodal Large Language Models'☆162Updated 3 months ago
- [ECCV24] VISA: Reasoning Video Object Segmentation via Large Language Model☆15Updated 9 months ago
- Think or Not Think: A Study of Explicit Thinking in Rule-Based Visual Reinforcement Fine-Tuning☆22Updated 2 weeks ago
- [CVPR 2024] Official Code for the Paper "Compositional Chain-of-Thought Prompting for Large Multimodal Models"☆125Updated 10 months ago
- [CVPR 2025] Adaptive Keyframe Sampling for Long Video Understanding☆56Updated this week
- This repository will continuously update the latest papers, technical reports, benchmarks about multimodal reasoning!☆35Updated last month
- A Self-Training Framework for Vision-Language Reasoning☆76Updated 3 months ago
- Implementation of "VL-Mamba: Exploring State Space Models for Multimodal Learning"☆81Updated last year
- [ICLR'25] Official code for the paper 'MLLMs Know Where to Look: Training-free Perception of Small Visual Details with Multimodal LLMs'☆154Updated this week
- [CVPR' 25] Interleaved-Modal Chain-of-Thought☆28Updated this week
- MMICL, a state-of-the-art VLM with the in context learning ability from ICL, PKU☆46Updated last year
- Reason-RFT: Reinforcement Fine-Tuning for Visual Reasoning.☆101Updated this week
- A Comprehensive Survey on Evaluating Reasoning Capabilities in Multimodal Large Language Models.☆56Updated last month
- [CVPR 2024] Code for HiKER-SGG: Hierarchical Knowledge Enhanced Robust Scene Graph Generation☆70Updated 6 months ago
- Code for paper: Visual Signal Enhancement for Object Hallucination Mitigation in Multimodal Large language Models☆15Updated 4 months ago
- Official implementation of "Why are Visually-Grounded Language Models Bad at Image Classification?" (NeurIPS 2024)☆79Updated 6 months ago
- ☆113Updated 2 months ago
- ☆73Updated 3 months ago
- code for studying OpenAI's CLIP explainability☆31Updated 3 years ago
- ✨A curated list of papers on the uncertainty in multi-modal large language model (MLLM).☆44Updated 3 weeks ago
- Official repository of DoraemonGPT: Toward Understanding Dynamic Scenes with Large Language Models☆84Updated 7 months ago
- 🔎Official code for our paper: "VL-Uncertainty: Detecting Hallucination in Large Vision-Language Model via Uncertainty Estimation".☆32Updated last month
- ☆103Updated 2 weeks ago
- [NeurIPS 2023] The official implementation of SOC: Semantic-Assisted Object Cluster for Referring Video Object Segmentation☆31Updated last year
- ☆80Updated last month
- Official code for paper: [CLS] Attention is All You Need for Training-Free Visual Token Pruning: Make VLM Inference Faster.☆70Updated 4 months ago
- [ECCV 2024] Paying More Attention to Image: A Training-Free Method for Alleviating Hallucination in LVLMs☆114Updated 5 months ago
- [ICLR2025] Text4Seg: Reimagining Image Segmentation as Text Generation☆87Updated 3 weeks ago
- [CVPR 2025 (Oral)] Mitigating Hallucinations in Large Vision-Language Models via DPO: On-Policy Data Hold the Key☆48Updated 3 weeks ago