Alternatives and similar repositories for SpecVLM

Users that are interested in SpecVLM are comparing it to the libraries listed below

• pprp / Awesome-Efficient-MoE
  Efficient Mixture of Experts for LLM Paper List
  ☆145Updated 2 months ago
• FFY0 / AdaKV
  The Official Implementation of Ada-KV [NeurIPS 2025]
  ☆118Updated 2 weeks ago
• Osilly / dynamic_llava
  [ICLR 2025] The official pytorch implement of "Dynamic-LLaVA: Efficient Multimodal Large Language Models via Dynamic Vision-language Cont…
  ☆63Updated 2 months ago
• AIoT-MLSys-Lab / MEDA
  [NAACL 2025🔥] MEDA: Dynamic KV Cache Allocation for Efficient Multimodal Long-Context Inference
  ☆15Updated 5 months ago
• SUSTechBruce / LOOK-M
  [EMNLP 2024 Findings🔥] Official implementation of ": LOOK-M: Look-Once Optimization in KV Cache for Efficient Multimodal Long-Context In…
  ☆104Updated last year
• lzhxmu / VTW
  Code release for VTW (AAAI 2025 Oral)
  ☆65Updated last month
• antgroup / cakekv
  ☆31Updated 8 months ago
• TemporaryLoRA / Block-Attention
  ☆41Updated 8 months ago
• smart-lty / ParallelSpeculativeDecoding
  [ICLR 2025] PEARL: Parallel Speculative Decoding with Adaptive Draft Length
  ☆132Updated last month
• SuDIS-ZJU / llm-inference-all-in-one
  ☆14Updated 9 months ago
• Zefan-Cai / Awesome-LLM-KV-Cache
  Awesome-LLM-KV-Cache: A curated list of 📙Awesome LLM KV Cache Papers with Codes.
  ☆399Updated 9 months ago
• xuyang-liu16 / Awesome-Token-level-Model-Compression
  📚 Collection of token-level model compression resources.
  ☆184Updated 3 months ago
• JinXins / Awesome-Token-Merge-for-MLLMs
  A paper list about Token Merge, Reduce, Resample, Drop for MLLMs.
  ☆77Updated last month
• maomaocun / dLLM-cache
  Official PyTorch implementation of the paper "dLLM-Cache: Accelerating Diffusion Large Language Models with Adaptive Caching" (dLLM-Cache…
  ☆186Updated 3 weeks ago
• hemingkx / SWIFT
  [ICLR 2025] SWIFT: On-the-Fly Self-Speculative Decoding for LLM Inference Acceleration
  ☆61Updated 9 months ago
• mdy666 / Qwen-Native-Sparse-Attention
  qwen-nsa
  ☆84Updated last month
• ZichenWen1 / DART
  [EMNLP 2025 main 🔥] Code for "Stop Looking for Important Tokens in Multimodal Language Models: Duplication Matters More"
  ☆95Updated last month
• fscdc / Awesome-Efficient-Reasoning-Models
  [TMLR 2025] Efficient Reasoning Models: A Survey
  ☆282Updated last month
• dhcode-cpp / NSA-pytorch
  DeepSeek Native Sparse Attention pytorch implementation
  ☆109Updated last month
• dilab-zju / self-speculative-decoding
  Code associated with the paper **Draft & Verify: Lossless Large Language Model Acceleration via Self-Speculative Decoding**
  ☆212Updated 9 months ago
• EffiVLM-Bench / EffiVLM-Bench
  ☆30Updated 6 months ago
• ThisisBillhe / ZipCache
  [NeurIPS 2024] The official implementation of ZipCache: Accurate and Efficient KV Cache Quantization with Salient Token Identification
  ☆30Updated 8 months ago
• ByteDance-Seed / FlexPrefill
  Code for paper: [ICLR2025 Oral] FlexPrefill: A Context-Aware Sparse Attention Mechanism for Efficient Long-Sequence Inference
  ☆156Updated last month
• mozhu621 / LongGenBench
  ☆29Updated 2 months ago
• FasterDecoding / SnapKV
  ☆293Updated 5 months ago
• wangqinsi1 / CoreInfer
  This is the official Python version of CoreInfer: Accelerating Large Language Model Inference with Semantics-Inspired Adaptive Sparse Act…
  ☆17Updated last year
• mutonix / pyramidinfer
  ☆49Updated last year
• thunlp / FR-Spec
  [ACL 2025 main] FR-Spec: Frequency-Ranked Speculative Sampling
  ☆49Updated 4 months ago
• October2001 / Awesome-KV-Cache-Compression
  📰 Must-read papers on KV Cache Compression (constantly updating 🤗).
  ☆617Updated 2 months ago
• pkunlp-icler / FastV
  [ECCV 2024 Oral] Code for paper: An Image is Worth 1/2 Tokens After Layer 2: Plug-and-Play Inference Acceleration for Large Vision-Langua…
  ☆531Updated 11 months ago