LaVi-Lab / AIM
Official code for "AIM: Adaptive Inference of Multi-Modal LLMs via Token Merging and Pruning"
☆26Updated last month
Alternatives and similar repositories for AIM:
Users that are interested in AIM are comparing it to the libraries listed below
- [NeurIPS 2024] Calibrated Self-Rewarding Vision Language Models☆73Updated 11 months ago
- The official repository for paper "PruneVid: Visual Token Pruning for Efficient Video Large Language Models".☆38Updated 2 months ago
- 【NeurIPS 2024】The official code of paper "Automated Multi-level Preference for MLLMs"☆19Updated 7 months ago
- VideoNIAH: A Flexible Synthetic Method for Benchmarking Video MLLMs☆47Updated 2 months ago
- ☆30Updated 9 months ago
- [NeurIPS2024] Official code for (IMA) Implicit Multimodal Alignment: On the Generalization of Frozen LLMs to Multimodal Inputs☆18Updated 6 months ago
- HalluciDoctor: Mitigating Hallucinatory Toxicity in Visual Instruction Data (Accepted by CVPR 2024)☆45Updated 9 months ago
- [CVPR 2025] PVC: Progressive Visual Token Compression for Unified Image and Video Processing in Large Vision-Language Models☆39Updated 2 months ago
- [ICLR2025] γ -MOD: Mixture-of-Depth Adaptation for Multimodal Large Language Models☆36Updated 2 months ago
- ☆25Updated 11 months ago
- [NeurIPS'24] Official PyTorch Implementation of Seeing the Image: Prioritizing Visual Correlation by Contrastive Alignment☆56Updated 7 months ago
- ☆44Updated this week
- VisRL: Intention-Driven Visual Perception via Reinforced Reasoning☆27Updated last month
- Multi-Stage Vision Token Dropping: Towards Efficient Multimodal Large Language Model☆28Updated 4 months ago
- FreeVA: Offline MLLM as Training-Free Video Assistant☆61Updated 11 months ago
- TimeChat-online: 80% Visual Tokens are Naturally Redundant in Streaming Videos☆13Updated this week
- [ICCV2023] Official code for "VL-PET: Vision-and-Language Parameter-Efficient Tuning via Granularity Control"☆53Updated last year
- [CVPR2024 Highlight] Official implementation for Transferable Visual Prompting. The paper "Exploring the Transferability of Visual Prompt…☆39Updated 4 months ago
- This is the official repo for ByteVideoLLM/Dynamic-VLM☆20Updated 4 months ago
- VideoHallucer, The first comprehensive benchmark for hallucination detection in large video-language models (LVLMs)☆29Updated last month
- The official implementation of 《MLLMs-Augmented Visual-Language Representation Learning》☆31Updated last year
- ☆24Updated 3 months ago
- Official repository of "CoMP: Continual Multimodal Pre-training for Vision Foundation Models"☆25Updated last month
- Official code for "What Makes for Good Visual Tokenizers for Large Language Models?".☆58Updated last year
- ☆75Updated 4 months ago
- VisualGPTScore for visio-linguistic reasoning☆27Updated last year
- Official PyTorch code of GroundVQA (CVPR'24)☆60Updated 7 months ago
- ☆41Updated 6 months ago
- ☆35Updated 10 months ago
- PyTorch code for "Contrastive Region Guidance: Improving Grounding in Vision-Language Models without Training"☆34Updated last year