JackYFL / awesome-VLLMs
This repository collects papers on VLLM applications. We will update new papers irregularly.
☆121Updated last week
Alternatives and similar repositories for awesome-VLLMs
Users that are interested in awesome-VLLMs are comparing it to the libraries listed below
Sorting:
- [CVPR 2024] Official Code for the Paper "Compositional Chain-of-Thought Prompting for Large Multimodal Models"☆125Updated 10 months ago
- Collections of Papers and Projects for Multimodal Reasoning.☆104Updated 3 weeks ago
- [ICLR'25] Official code for the paper 'MLLMs Know Where to Look: Training-free Perception of Small Visual Details with Multimodal LLMs'☆192Updated 3 weeks ago
- The Next Step Forward in Multimodal LLM Alignment☆154Updated 2 weeks ago
- [Neurips'24 Spotlight] Visual CoT: Advancing Multi-Modal Language Models with a Comprehensive Dataset and Benchmark for Chain-of-Thought …☆314Updated 4 months ago
- A paper list about Token Merge, Reduce, Resample, Drop for MLLMs.☆54Updated 4 months ago
- [CVPR2025 Highlight] Insight-V: Exploring Long-Chain Visual Reasoning with Multimodal Large Language Models☆189Updated last month
- ☆331Updated last year
- [NeurIPS 2024] Classification Done Right for Vision-Language Pre-Training☆207Updated last month
- ☆117Updated 3 months ago
- [ICLR 2025] LLaVA-MoD: Making LLaVA Tiny via MoE-Knowledge Distillation☆157Updated last month
- [NeurIPS2024] Repo for the paper `ControlMLLM: Training-Free Visual Prompt Learning for Multimodal Large Language Models'☆167Updated 3 months ago
- Collection of papers and repos for multimodal chain-of-thought☆82Updated 6 months ago
- ✨✨ [ICLR 2025] MME-RealWorld: Could Your Multimodal LLM Challenge High-Resolution Real-World Scenarios that are Difficult for Humans?☆118Updated 2 months ago
- A Comprehensive Survey on Evaluating Reasoning Capabilities in Multimodal Large Language Models.☆60Updated 2 months ago
- Awesome papers & datasets specifically focused on long-term videos.☆271Updated 6 months ago
- Project Page For "Seg-Zero: Reasoning-Chain Guided Segmentation via Cognitive Reinforcement"☆341Updated last month
- ✨First Open-Source R1-like Video-LLM [2025/02/18]☆335Updated 2 months ago
- Video-R1: Reinforcing Video Reasoning in MLLMs [🔥the first paper to explore R1 for video]☆515Updated this week
- Official implementation of the Law of Vision Representation in MLLMs☆155Updated 6 months ago
- Official implementation of "Why are Visually-Grounded Language Models Bad at Image Classification?" (NeurIPS 2024)☆81Updated 6 months ago
- [ECCV 2024 Oral] Code for paper: An Image is Worth 1/2 Tokens After Layer 2: Plug-and-Play Inference Acceleration for Large Vision-Langua…☆425Updated 4 months ago
- Visualizing the attention of vision-language models☆171Updated 2 months ago
- Official code for paper: [CLS] Attention is All You Need for Training-Free Visual Token Pruning: Make VLM Inference Faster.☆75Updated 5 months ago
- [ICLR 2025] VILA-U: a Unified Foundation Model Integrating Visual Understanding and Generation☆315Updated 3 weeks ago
- A most Frontend Collection and survey of vision-language model papers, and models GitHub repository☆191Updated last week
- A Survey on Benchmarks of Multimodal Large Language Models☆103Updated last month
- ICML'2024 | MMT-Bench: A Comprehensive Multimodal Benchmark for Evaluating Large Vision-Language Models Towards Multitask AGI☆109Updated 10 months ago
- Official code implementation of Perception R1: Pioneering Perception Policy with Reinforcement Learning☆167Updated 3 weeks ago
- [NeurIPS 2024] MoME: Mixture of Multimodal Experts for Generalist Multimodal Large Language Models☆61Updated last week