EIT-NLP / Connector-Selection-for-MLLMLinks
[EMNLP 2024 Main] Official implementation of the paper "To Preserve or To Compress: An In-Depth Study of Connector Selection in Multimodal Large Language Models". (by Junyan Lin)
☆15Updated 5 months ago
Alternatives and similar repositories for Connector-Selection-for-MLLM
Users that are interested in Connector-Selection-for-MLLM are comparing it to the libraries listed below
Sorting:
- This repository will continuously update the latest papers, technical reports, benchmarks about multimodal reasoning!☆41Updated 2 months ago
- A Self-Training Framework for Vision-Language Reasoning☆80Updated 4 months ago
- VoCoT: Unleashing Visually Grounded Multi-Step Reasoning in Large Multi-Modal Models☆63Updated 10 months ago
- ☆101Updated last month
- [CVPR' 25] Interleaved-Modal Chain-of-Thought☆45Updated last month
- ☆74Updated last year
- Code release for VTW (AAAI 2025) Oral☆43Updated 4 months ago
- A Comprehensive Survey on Evaluating Reasoning Capabilities in Multimodal Large Language Models.☆63Updated 2 months ago
- [EMNLP 2024 Main] Official implementation of the paper "The Accuracy Paradox in RLHF: When Better Reward Models Don't Yield Better Langua…☆14Updated 6 months ago
- Visual Instruction Tuning for Qwen2 Base Model☆34Updated 11 months ago
- Resources and paper list for "Thinking with Images for LVLMs". This repository accompanies our survey on how LVLMs can leverage visual in…☆126Updated this week
- Official resource for paper Investigating and Mitigating the Multimodal Hallucination Snowballing in Large Vision-Language Models (ACL 20…☆12Updated 9 months ago
- [CVPR2025] Official implementation of the paper "Multi-Layer Visual Feature Fusion in Multimodal LLMs: Methods, Analysis, and Best Practi…☆17Updated 3 months ago
- ☆84Updated 2 months ago
- A RLHF Infrastructure for Vision-Language Models☆176Updated 6 months ago
- [ICML 2025] Official implementation of paper 'Look Twice Before You Answer: Memory-Space Visual Retracing for Hallucination Mitigation in…☆124Updated last week
- [ICLR 2025] MLLM can see? Dynamic Correction Decoding for Hallucination Mitigation☆82Updated 5 months ago
- Latest Advances on Modality Priors in Multimodal Large Language Models☆20Updated last month
- ☆11Updated 6 months ago
- Code for paper: Visual Signal Enhancement for Object Hallucination Mitigation in Multimodal Large language Models☆19Updated 5 months ago
- [Blog 1] Recording a bug of grpo_trainer in some R1 projects☆20Updated 3 months ago
- [NeurIPS2024] Repo for the paper `ControlMLLM: Training-Free Visual Prompt Learning for Multimodal Large Language Models'☆172Updated last week
- [LLaVA-Video-R1]✨First Adaptation of R1 to LLaVA-Video (2025-03-18)☆28Updated 3 weeks ago
- EchoInk-R1: Exploring Audio-Visual Reasoning in Multimodal LLMs via Reinforcement Learning [🔥The Exploration of R1 for General Audio-Vi…☆31Updated 2 weeks ago
- [EMNLP 2024 Findings] The official PyTorch implementation of EchoSight: Advancing Visual-Language Models with Wiki Knowledge.☆61Updated 2 months ago
- ☆22Updated last month
- ☆46Updated last month
- Code for "Stop Looking for Important Tokens in Multimodal Language Models: Duplication Matters More"☆49Updated last month
- [ICLR'25] Official code for the paper 'MLLMs Know Where to Look: Training-free Perception of Small Visual Details with Multimodal LLMs'☆207Updated last month
- ⭐️ Reason-RFT: Reinforcement Fine-Tuning for Visual Reasoning.☆157Updated 2 weeks ago