EIT-NLP / Connector-Selection-for-MLLM
[EMNLP 2024 Main] Official implementation of the paper "To Preserve or To Compress: An In-Depth Study of Connector Selection in Multimodal Large Language Models". (by Junyan Lin)
☆14Updated 3 months ago
Alternatives and similar repositories for Connector-Selection-for-MLLM:
Users that are interested in Connector-Selection-for-MLLM are comparing it to the libraries listed below
- ☆71Updated last week
- A Self-Training Framework for Vision-Language Reasoning☆71Updated 2 months ago
- ☆64Updated 9 months ago
- Official implementation of paper 'Look Twice Before You Answer: Memory-Space Visual Retracing for Hallucination Mitigation in Multimodal …☆46Updated last month
- Code release for VTW (AAAI 2025) Oral☆33Updated 2 months ago
- 🔥CVPR 2025 Multimodal Large Language Models Paper List☆119Updated 2 weeks ago
- ☆90Updated this week
- This repository contains the code for SFT, RLHF, and DPO, designed for vision-based LLMs, including the LLaVA models and the LLaMA-3.2-vi…☆102Updated 5 months ago
- ☆40Updated 2 months ago
- A hot-pluggable tool for visualizing LLaVA's attention.☆14Updated last year
- VoCoT: Unleashing Visually Grounded Multi-Step Reasoning in Large Multi-Modal Models☆49Updated 8 months ago
- ☆11Updated 4 months ago
- [EMNLP 2024 Findings] The official PyTorch implementation of EchoSight: Advancing Visual-Language Models with Wiki Knowledge.☆55Updated 2 weeks ago
- A Comprehensive Survey on Evaluating Reasoning Capabilities in Multimodal Large Language Models.☆44Updated last week
- This is the first released survey paper on hallucinations of large vision-language models (LVLMs). To keep track of this field and contin…☆63Updated 8 months ago
- [ICLR'25] Official code for the paper 'MLLMs Know Where to Look: Training-free Perception of Small Visual Details with Multimodal LLMs'☆89Updated last week
- PyTorch Implementation of "Divide, Conquer and Combine: A Training-Free Framework for High-Resolution Image Perception in Multimodal Larg…☆21Updated last month
- [Open LLaVA-Video-R1]✨First Adaptation of R1 to LLaVA-Video☆19Updated last week
- (CVPR 2025) PyramidDrop: Accelerating Your Large Vision-Language Models via Pyramid Visual Redundancy Reduction☆81Updated 3 weeks ago
- 🔥🔥🔥Code for "Empowering Multimodal Large Language Models with Evol-Instruct"☆13Updated last month
- Video-R1: Towards Super Reasoning Ability in Video Understanding MLLMs☆105Updated last month
- MME-CoT: Benchmarking Chain-of-Thought in LMMs for Reasoning Quality, Robustness, and Efficiency☆92Updated last week
- [ECCV 2024] Paying More Attention to Image: A Training-Free Method for Alleviating Hallucination in LVLMs☆109Updated 4 months ago
- [NeurIPS2024] Repo for the paper `ControlMLLM: Training-Free Visual Prompt Learning for Multimodal Large Language Models'☆153Updated 2 months ago
- Official PyTorch code of "Enhancing Video-LLM Reasoning via Agent-of-Thoughts Distillation".☆22Updated last month
- A RLHF Infrastructure for Vision-Language Models☆167Updated 4 months ago
- R1-Vision: Let's first take a look at the image☆39Updated last month
- Official repository of MMDU dataset☆86Updated 5 months ago
- MultiMath: Bridging Visual and Mathematical Reasoning for Large Language Models☆27Updated 2 months ago
- Less is More: Mitigating Multimodal Hallucination from an EOS Decision Perspective (ACL 2024)☆44Updated 5 months ago