EIT-NLP / Layer_Select_Fuse_for_MLLMLinks
[CVPR2025] Official implementation of the paper "Multi-Layer Visual Feature Fusion in Multimodal LLMs: Methods, Analysis, and Best Practices". (by Junyan Lin)
☆25Updated last month
Alternatives and similar repositories for Layer_Select_Fuse_for_MLLM
Users that are interested in Layer_Select_Fuse_for_MLLM are comparing it to the libraries listed below
Sorting:
- [NeurIPS2024] Repo for the paper `ControlMLLM: Training-Free Visual Prompt Learning for Multimodal Large Language Models'☆184Updated this week
- [ICLR'25] Official code for the paper 'MLLMs Know Where to Look: Training-free Perception of Small Visual Details with Multimodal LLMs'☆230Updated 2 months ago
- Code for paper: Visual Signal Enhancement for Object Hallucination Mitigation in Multimodal Large language Models☆24Updated 7 months ago
- [LLaVA-Video-R1]✨First Adaptation of R1 to LLaVA-Video (2025-03-18)☆29Updated 2 months ago
- [CVPR 2024] Official Code for the Paper "Compositional Chain-of-Thought Prompting for Large Multimodal Models"☆133Updated last year
- Code for DeCo: Decoupling token compression from semanchc abstraction in multimodal large language models☆40Updated this week
- The official implementation of RAR☆88Updated last year
- VoCoT: Unleashing Visually Grounded Multi-Step Reasoning in Large Multi-Modal Models☆69Updated last year
- [NeurIPS 2023] The official implementation of SOC: Semantic-Assisted Object Cluster for Referring Video Object Segmentation☆32Updated last year
- Collections of Papers and Projects for Multimodal Reasoning.☆105Updated 2 months ago
- [ECCV24] VISA: Reasoning Video Object Segmentation via Large Language Model☆17Updated 11 months ago
- Reinforcement Learning Tuning for VideoLLMs: Reward Design and Data Efficiency☆44Updated last month
- [CVPR 2025] Adaptive Keyframe Sampling for Long Video Understanding☆80Updated 2 months ago
- [CVPR' 25] Interleaved-Modal Chain-of-Thought☆62Updated 2 months ago
- A Comprehensive Survey on Evaluating Reasoning Capabilities in Multimodal Large Language Models.☆66Updated 4 months ago
- [NeurIPS 2024] Visual Perception by Large Language Model’s Weights☆45Updated 3 months ago
- [Blog 1] Recording a bug of grpo_trainer in some R1 projects☆20Updated 4 months ago
- Implementation of "VL-Mamba: Exploring State Space Models for Multimodal Learning"☆81Updated last year
- [AAAI 2025] Open-vocabulary Video Instance Segmentation Codebase built upon Detectron2, which is really easy to use.☆23Updated 6 months ago
- 🔥CVPR 2025 Multimodal Large Language Models Paper List☆147Updated 4 months ago
- Think or Not Think: A Study of Explicit Thinking in Rule-Based Visual Reinforcement Fine-Tuning☆51Updated 2 months ago
- Official code implementation of Perception R1: Pioneering Perception Policy with Reinforcement Learning☆222Updated this week
- [Neurips'24 Spotlight] Visual CoT: Advancing Multi-Modal Language Models with a Comprehensive Dataset and Benchmark for Chain-of-Thought …☆345Updated 6 months ago
- Latest open-source "Thinking with images" (O3/O4-mini) papers, covering training-free, SFT-based, and RL-enhanced methods for "fine-grain…☆75Updated last week
- ⭐️ Reason-RFT: Reinforcement Fine-Tuning for Visual Reasoning.☆174Updated last month
- MMICL, a state-of-the-art VLM with the in context learning ability from ICL, PKU☆48Updated this week
- Latest Advances on (RL based) Multimodal Reasoning and Generation in Multimodal Large Language Models☆30Updated this week
- This repository will continuously update the latest papers, technical reports, benchmarks about multimodal reasoning!☆47Updated 3 months ago
- [CVPR 2025] LamRA: Large Multimodal Model as Your Advanced Retrieval Assistant☆128Updated last week
- [CVPR2024] GSVA: Generalized Segmentation via Multimodal Large Language Models☆137Updated 10 months ago