ZLKong / awesome-token-reduction
A collection of recent token reduction (token pruning, merging, clustering, etc.) techniques for ML/AI
☆27Updated last week
Alternatives and similar repositories for awesome-token-reduction:
Users that are interested in awesome-token-reduction are comparing it to the libraries listed below
- 📚 Collection of token reduction for model compression resources.☆47Updated last week
- Official implementation of paper "SparseVLM: Visual Token Sparsification for Efficient Vision-Language Model Inference".☆83Updated 3 weeks ago
- Code release for VTW (AAAI 2025) Oral☆33Updated 2 months ago
- A paper list about Token Merge, Reduce, Resample, Drop for MLLMs.☆44Updated 2 months ago
- ☆41Updated 2 months ago
- Code for "Stop Looking for Important Tokens in Multimodal Language Models: Duplication Matters More"☆26Updated this week
- Official code for paper: [CLS] Attention is All You Need for Training-Free Visual Token Pruning: Make VLM Inference Faster.☆59Updated 3 months ago
- LLaVA-PruMerge: Adaptive Token Reduction for Efficient Large Multimodal Models☆121Updated 10 months ago
- [ICLR 2025] Dynamic Mixture of Experts: An Auto-Tuning Approach for Efficient Transformer Models☆80Updated last month
- (CVPR 2025) PyramidDrop: Accelerating Your Large Vision-Language Models via Pyramid Visual Redundancy Reduction☆81Updated 3 weeks ago
- [EMNLP 2024 Findings🔥] Official implementation of ": LOOK-M: Look-Once Optimization in KV Cache for Efficient Multimodal Long-Context In…☆92Updated 4 months ago
- ☆45Updated 4 months ago
- [ICLR2025] γ -MOD: Mixture-of-Depth Adaptation for Multimodal Large Language Models☆33Updated last month
- [ICLR 2025] The official pytorch implement of "Dynamic-LLaVA: Efficient Multimodal Large Language Models via Dynamic Vision-language Cont…☆26Updated 4 months ago
- ☆124Updated this week
- ☆99Updated 8 months ago
- ☆107Updated last month
- The official implementation of "2024NeurIPS Dynamic Tuning Towards Parameter and Inference Efficiency for ViT Adaptation"☆43Updated 3 months ago
- DyCoke: Dynamic Compression of Tokens for Fast Video Large Language Models☆38Updated last week
- ☆74Updated last week
- CoT-Valve: Length-Compressible Chain-of-Thought Tuning☆56Updated last month
- CorDA: Context-Oriented Decomposition Adaptation of Large Language Models for task-aware parameter-efficient fine-tuning(NeurIPS 2024)☆45Updated 2 months ago
- This is the official implementation of our paper "QuoTA: Query-oriented Token Assignment via CoT Query Decouple for Long Video Comprehens…☆64Updated 2 weeks ago
- Data distillation benchmark☆58Updated this week
- [NeurIPS'24]Efficient and accurate memory saving method towards W4A4 large multi-modal models.☆68Updated 2 months ago
- [ICLR'25] Official code for the paper 'MLLMs Know Where to Look: Training-free Perception of Small Visual Details with Multimodal LLMs'☆97Updated last week
- Official implementation of paper 'Look Twice Before You Answer: Memory-Space Visual Retracing for Hallucination Mitigation in Multimodal …☆46Updated last month
- [ECCV 2024] API: Attention Prompting on Image for Large Vision-Language Models☆79Updated 5 months ago
- [NeurIPS 2024] Visual Perception by Large Language Model’s Weights☆41Updated 5 months ago
- A paper list of some recent works about Token Compress for Vit and VLM☆391Updated this week