taishan1994 / llava-handbook
对llava官方代码的一些学习笔记
☆24Updated 7 months ago
Alternatives and similar repositories for llava-handbook
Users that are interested in llava-handbook are comparing it to the libraries listed below
Sorting:
- [ECCV 2024] Paying More Attention to Image: A Training-Free Method for Alleviating Hallucination in LVLMs☆116Updated 6 months ago
- A Comprehensive Survey on Evaluating Reasoning Capabilities in Multimodal Large Language Models.☆60Updated last month
- VoCoT: Unleashing Visually Grounded Multi-Step Reasoning in Large Multi-Modal Models☆56Updated 10 months ago
- Visual Instruction Tuning for Qwen2 Base Model☆33Updated 10 months ago
- This is the official implementation of our paper "QuoTA: Query-oriented Token Assignment via CoT Query Decouple for Long Video Comprehens…☆69Updated 2 weeks ago
- The Next Step Forward in Multimodal LLM Alignment☆154Updated 2 weeks ago
- MME-CoT: Benchmarking Chain-of-Thought in LMMs for Reasoning Quality, Robustness, and Efficiency☆104Updated 2 weeks ago
- [ICLR'25] Official code for the paper 'MLLMs Know Where to Look: Training-free Perception of Small Visual Details with Multimodal LLMs'☆192Updated 3 weeks ago
- MME-Unify: A Comprehensive Benchmark for Unified Multimodal Understanding and Generation Models☆34Updated last month
- ☆47Updated 5 months ago
- [EMNLP 2024 Findings🔥] Official implementation of ": LOOK-M: Look-Once Optimization in KV Cache for Efficient Multimodal Long-Context In…☆93Updated 6 months ago
- [CVPR' 25] Interleaved-Modal Chain-of-Thought☆39Updated 3 weeks ago
- Code release for VTW (AAAI 2025) Oral☆39Updated 3 months ago
- A paper list about Token Merge, Reduce, Resample, Drop for MLLMs.☆54Updated 4 months ago
- [ICLR 2025] The official pytorch implement of "Dynamic-LLaVA: Efficient Multimodal Large Language Models via Dynamic Vision-language Cont…☆36Updated 5 months ago
- ☆117Updated 3 months ago
- Think or Not Think: A Study of Explicit Thinking in Rule-Based Visual Reinforcement Fine-Tuning☆36Updated 2 weeks ago
- [NeurIPS2024] Repo for the paper `ControlMLLM: Training-Free Visual Prompt Learning for Multimodal Large Language Models'☆167Updated 3 months ago
- This project aims to collect and collate various datasets for multimodal large model training, including but not limited to pre-training …☆43Updated last week
- Collections of Papers and Projects for Multimodal Reasoning.☆104Updated 3 weeks ago
- ☆83Updated last month
- ☆85Updated last year
- ☆59Updated 2 months ago
- The official GitHub page for ''Evaluating Object Hallucination in Large Vision-Language Models''☆207Updated last year
- [ICLR 2025] MLLM can see? Dynamic Correction Decoding for Hallucination Mitigation☆74Updated 5 months ago
- [CVPR 2024 Highlight] Mitigating Object Hallucinations in Large Vision-Language Models through Visual Contrastive Decoding☆274Updated 7 months ago
- ☆44Updated last week
- [Blog 1] Recording a bug of grpo_trainer in some R1 projects☆20Updated 2 months ago
- A Survey on Benchmarks of Multimodal Large Language Models☆103Updated last month
- [ICLR 2025] LLaVA-MoD: Making LLaVA Tiny via MoE-Knowledge Distillation☆157Updated last month