taishan1994 / llava-handbook
对llava官方代码的一些学习笔记
☆22Updated 6 months ago
Alternatives and similar repositories for llava-handbook:
Users that are interested in llava-handbook are comparing it to the libraries listed below
- A Comprehensive Survey on Evaluating Reasoning Capabilities in Multimodal Large Language Models.☆56Updated last month
- [ICLR'25] Official code for the paper 'MLLMs Know Where to Look: Training-free Perception of Small Visual Details with Multimodal LLMs'☆154Updated this week
- [EMNLP 2024 Findings🔥] Official implementation of ": LOOK-M: Look-Once Optimization in KV Cache for Efficient Multimodal Long-Context In…☆92Updated 5 months ago
- Visual Instruction Tuning for Qwen2 Base Model☆32Updated 9 months ago
- [NeurIPS2024] Repo for the paper `ControlMLLM: Training-Free Visual Prompt Learning for Multimodal Large Language Models'☆162Updated 3 months ago
- This is the official implementation of our paper "QuoTA: Query-oriented Token Assignment via CoT Query Decouple for Long Video Comprehens…☆68Updated last month
- [ECCV 2024] Paying More Attention to Image: A Training-Free Method for Alleviating Hallucination in LVLMs☆114Updated 5 months ago
- Official code for paper: [CLS] Attention is All You Need for Training-Free Visual Token Pruning: Make VLM Inference Faster.☆70Updated 4 months ago
- ☆103Updated 2 weeks ago
- Code for "Stop Looking for Important Tokens in Multimodal Language Models: Duplication Matters More"☆36Updated 3 weeks ago
- Code release for VTW (AAAI 2025) Oral☆34Updated 3 months ago
- MME-CoT: Benchmarking Chain-of-Thought in LMMs for Reasoning Quality, Robustness, and Efficiency☆100Updated 3 weeks ago
- [ICLR 2025] LLaVA-MoD: Making LLaVA Tiny via MoE-Knowledge Distillation☆140Updated 3 weeks ago
- ☆42Updated 3 months ago
- A paper list about Token Merge, Reduce, Resample, Drop for MLLMs.☆50Updated 3 months ago
- LLaVA-PruMerge: Adaptive Token Reduction for Efficient Large Multimodal Models☆126Updated 11 months ago
- ☆113Updated 2 months ago
- (CVPR 2025) PyramidDrop: Accelerating Your Large Vision-Language Models via Pyramid Visual Redundancy Reduction☆89Updated last month
- The Next Step Forward in Multimodal LLM Alignment☆145Updated last month
- VoCoT: Unleashing Visually Grounded Multi-Step Reasoning in Large Multi-Modal Models☆53Updated 9 months ago
- The official implementation of RAR☆86Updated last year
- [CVPR 2025] LamRA: Large Multimodal Model as Your Advanced Retrieval Assistant☆102Updated last month
- 🔥CVPR 2025 Multimodal Large Language Models Paper List☆136Updated last month
- ☆48Updated 5 months ago
- ☆80Updated last month
- Official repository of MMDU dataset☆89Updated 6 months ago
- ☆83Updated 11 months ago
- R1-Vision: Let's first take a look at the image☆46Updated 2 months ago
- Official implementation of paper "SparseVLM: Visual Token Sparsification for Efficient Vision-Language Model Inference".☆93Updated last month
- [ICLR2025 Oral] ChartMoE: Mixture of Diversely Aligned Expert Connector for Chart Understanding☆75Updated 3 weeks ago