SUSTechBruce / LOOK-M
Official implementation of "LOOK-M: Look-Once Optimization in KV Cache for Efficient Multimodal Long-Context Inference"
☆59Updated 2 months ago
Related projects: ⓘ
- ☆19Updated last month
- LLaVA-PruMerge: Adaptive Token Reduction for Efficient Large Multimodal Models☆86Updated 4 months ago
- MoCLE (First MLLM with MoE for instruction customization and generalization!) (https://arxiv.org/abs/2312.12379)☆28Updated 5 months ago
- A RLHF Infrastructure for Vision-Language Models☆85Updated 3 months ago
- MLLM-Bench: Evaluating Multimodal LLMs with Per-sample Criteria☆49Updated last month
- Official repository of MMDU dataset☆61Updated last month
- VoCoT: Unleashing Visually Grounded Multi-Step Reasoning in Large Multi-Modal Models☆23Updated 2 months ago
- HallE-Control: Controlling Object Hallucination in LMMs☆24Updated 5 months ago
- code for "Strengthening Multimodal Large Language Model with Bootstrapped Preference Optimization"☆40Updated 3 weeks ago
- A collection of visual instruction tuning datasets.☆74Updated 6 months ago
- ☆20Updated 4 months ago
- ☆73Updated 8 months ago
- This repo contains the codes for supervised fine-tuning (SFT) and reinforcement learning from human feedback (RLHF) designed for vision L…☆39Updated 2 weeks ago
- mPLUG-HalOwl: Multimodal Hallucination Evaluation and Mitigating☆72Updated 7 months ago
- ☆13Updated 10 months ago
- [CVPR 2024 Highlight] Mitigating Object Hallucinations in Large Vision-Language Models through Visual Contrastive Decoding☆177Updated 2 months ago
- ☆54Updated 2 months ago
- LVBench: An Extreme Long Video Understanding Benchmark☆51Updated 2 weeks ago
- DEEM: Official implementation of Diffusion models serve as the eyes of large language models for image perception.☆14Updated last month
- Official PyTorch Implementation of Seeing the Image: Prioritizing Visual Correlation by Contrastive Alignment☆44Updated 3 months ago
- [EMNLP'23] The official GitHub page for ''Evaluating Object Hallucination in Large Vision-Language Models''☆67Updated 5 months ago
- An benchmark for evaluating the capabilities of large vision-language models (LVLMs)☆32Updated 10 months ago
- The official GitHub page for ''Evaluating Object Hallucination in Large Vision-Language Models''☆166Updated 5 months ago
- Code for ACL 2024 accepted paper titled "SAPT: A Shared Attention Framework for Parameter-Efficient Continual Learning of Large Language …☆19Updated last month
- Enhancing Large Vision Language Models with Self-Training on Image Comprehension.☆50Updated 3 months ago
- Code for Math-LLaVA: Bootstrapping Mathematical Reasoning for Multimodal Large Language Models☆52Updated 2 months ago
- Less is More: Mitigating Multimodal Hallucination from an EOS Decision Perspective (ACL 2024)☆25Updated last month
- ☆83Updated 9 months ago
- ICML'2024 | MMT-Bench: A Comprehensive Multimodal Benchmark for Evaluating Large Vision-Language Models Towards Multitask AGI☆84Updated 2 months ago
- [ICCV2023] Official code for "VL-PET: Vision-and-Language Parameter-Efficient Tuning via Granularity Control"☆51Updated 11 months ago