thu-nics / FrameFusion
The official code implementation of paper "Combining Similarity and Importance for Video Token Reduction on Large Visual Language Models"
☆39Updated last month
Alternatives and similar repositories for FrameFusion
Users that are interested in FrameFusion are comparing it to the libraries listed below
Sorting:
- [NeurIPS'24]Efficient and accurate memory saving method towards W4A4 large multi-modal models.☆73Updated 4 months ago
- [ICML'25] Official implementation of paper "SparseVLM: Visual Token Sparsification for Efficient Vision-Language Model Inference".☆103Updated 2 weeks ago
- DyCoke: Dynamic Compression of Tokens for Fast Video Large Language Models☆46Updated last month
- Official code for paper: [CLS] Attention is All You Need for Training-Free Visual Token Pruning: Make VLM Inference Faster.☆74Updated 5 months ago
- 📚 Collection of token reduction for model compression resources.☆53Updated 2 weeks ago
- Code release for VTW (AAAI 2025) Oral☆39Updated 3 months ago
- LLaVA-PruMerge: Adaptive Token Reduction for Efficient Large Multimodal Models☆127Updated last year
- This is the official PyTorch implementation of "ZipAR: Accelerating Auto-regressive Image Generation through Spatial Locality"☆47Updated last month
- (CVPR 2025) PyramidDrop: Accelerating Your Large Vision-Language Models via Pyramid Visual Redundancy Reduction☆94Updated 2 months ago
- [NeurIPS 2024] The official implementation of ZipCache: Accurate and Efficient KV Cache Quantization with Salient Token Identification☆21Updated last month
- A paper list about Token Merge, Reduce, Resample, Drop for MLLMs.☆54Updated 4 months ago
- [ICLR 2025] Mixture Compressor for Mixture-of-Experts LLMs Gains More☆43Updated 3 months ago
- Code for "Stop Looking for Important Tokens in Multimodal Language Models: Duplication Matters More"☆40Updated 2 weeks ago
- The code repository of "MBQ: Modality-Balanced Quantization for Large Vision-Language Models"☆38Updated 2 months ago
- [CVPR 2025] Adaptive Keyframe Sampling for Long Video Understanding☆60Updated 3 weeks ago
- ☆83Updated last month
- ☆44Updated last week
- [EMNLP 2024 Findings🔥] Official implementation of ": LOOK-M: Look-Once Optimization in KV Cache for Efficient Multimodal Long-Context In…☆93Updated 6 months ago
- The official implementation of "2024NeurIPS Dynamic Tuning Towards Parameter and Inference Efficiency for ViT Adaptation"☆46Updated 4 months ago
- [ICLR 2025] The official pytorch implement of "Dynamic-LLaVA: Efficient Multimodal Large Language Models via Dynamic Vision-language Cont…☆36Updated 5 months ago
- ✈️ Towards Stabilized and Efficient Diffusion Transformers through Long-Skip-Connections with Spectral Constraints☆67Updated last month
- [Neurips 24' D&B] Official Dataloader and Evaluation Scripts for LongVideoBench.☆97Updated 9 months ago
- [ICLR'25] Reconstructive Visual Instruction Tuning☆83Updated last month
- This is the official implementation of our paper "QuoTA: Query-oriented Token Assignment via CoT Query Decouple for Long Video Comprehens…☆69Updated 2 weeks ago
- [ICLR 2025] VILA-U: a Unified Foundation Model Integrating Visual Understanding and Generation☆315Updated 3 weeks ago
- official impelmentation of Kangaroo: A Powerful Video-Language Model Supporting Long-context Video Input☆64Updated 8 months ago
- A collection of recent token reduction (token pruning, merging, clustering, etc.) techniques for ML/AI☆43Updated last week
- [AAAI 2025] HiRED strategically drops visual tokens in the image encoding stage to improve inference efficiency for High-Resolution Visio…☆33Updated 3 weeks ago
- ☆25Updated last month
- [ICLR 2025] LLaVA-MoD: Making LLaVA Tiny via MoE-Knowledge Distillation☆157Updated last month