LaVi-Lab / AIM
Official code for "AIM: Adaptive Inference of Multi-Modal LLMs via Token Merging and Pruning"
☆18Updated 2 months ago
Alternatives and similar repositories for AIM:
Users that are interested in AIM are comparing it to the libraries listed below
- This is the official repo for ByteVideoLLM/Dynamic-VLM☆19Updated 2 months ago
- Emerging Pixel Grounding in Large Multimodal Models Without Grounding Supervision☆29Updated 3 months ago
- ☆26Updated 6 months ago
- FreeVA: Offline MLLM as Training-Free Video Assistant☆55Updated 8 months ago
- Official implementation of paper ReTaKe: Reducing Temporal and Knowledge Redundancy for Long Video Understanding☆23Updated last month
- [ICLR 2025] The official pytorch implement of "Dynamic-LLaVA: Efficient Multimodal Large Language Models via Dynamic Vision-language Cont…☆19Updated 2 months ago
- [NeurIPS 2024] Calibrated Self-Rewarding Vision Language Models☆67Updated 8 months ago
- The official code of the paper "PyramidDrop: Accelerating Your Large Vision-Language Models via Pyramid Visual Redundancy Reduction".☆52Updated last month
- VideoNIAH: A Flexible Synthetic Method for Benchmarking Video MLLMs☆37Updated 3 months ago
- ACL'24 (Oral) Tuning Large Multimodal Models for Videos using Reinforcement Learning from AI Feedback☆59Updated 5 months ago
- Official PyTorch code of "Grounded Question-Answering in Long Egocentric Videos", accepted by CVPR 2024.☆56Updated 5 months ago
- Official Implementation of ISR-DPO:Aligning Large Multimodal Models for Videos by Iterative Self-Retrospective DPO (AAAI'25)☆14Updated this week
- ☆19Updated 3 months ago
- ☆17Updated 7 months ago
- Official implement of MIA-DPO☆49Updated 3 weeks ago
- [Neurips 24' D&B] Official Dataloader and Evaluation Scripts for LongVideoBench.☆85Updated 6 months ago
- 【NeurIPS 2024】The official code of paper "Automated Multi-level Preference for MLLMs"☆18Updated 4 months ago
- VideoHallucer, The first comprehensive benchmark for hallucination detection in large video-language models (LVLMs)☆26Updated 7 months ago
- TemporalBench: Benchmarking Fine-grained Temporal Understanding for Multimodal Video Models☆27Updated 3 months ago
- [ICML2024] Repo for the paper `Evaluating and Analyzing Relationship Hallucinations in Large Vision-Language Models'☆20Updated last month
- Official Implementation (Pytorch) of the "VidChain: Chain-of-Tasks with Metric-based Direct Preference Optimization for Dense Video Capti…☆15Updated 3 weeks ago
- [ECCV2024] Learning Video Context as Interleaved Multimodal Sequences☆35Updated last month
- [ICCV2023] Official code for "VL-PET: Vision-and-Language Parameter-Efficient Tuning via Granularity Control"☆53Updated last year
- VideoEspresso: A Large-Scale Chain-of-Thought Dataset for Fine-Grained Video Reasoning via Core Frame Selection☆50Updated last month
- ☆28Updated 7 months ago
- Official repo of the ICLR 2025 paper "MMWorld: Towards Multi-discipline Multi-faceted World Model Evaluation in Videos"☆24Updated 4 months ago
- [ICLR 2025] VL-ICL Bench: The Devil in the Details of Multimodal In-Context Learning☆43Updated last week
- HalluciDoctor: Mitigating Hallucinatory Toxicity in Visual Instruction Data (Accepted by CVPR 2024)☆43Updated 7 months ago
- Language Repository for Long Video Understanding☆31Updated 8 months ago