ASISys / AdaSkipLinks
AdaSkip: Adaptive Sublayer Skipping for Accelerating Long-Context LLM Inference
☆12Updated 5 months ago
Alternatives and similar repositories for AdaSkip
Users that are interested in AdaSkip are comparing it to the libraries listed below
Sorting:
- [ICLR 2025] TidalDecode: A Fast and Accurate LLM Decoding with Position Persistent Sparse Attention☆39Updated 2 months ago
- ☆14Updated last year
- SQUEEZED ATTENTION: Accelerating Long Prompt LLM Inference☆47Updated 7 months ago
- ☆11Updated 3 months ago
- ☆30Updated last month
- The official implementation of paper: SimLayerKV: A Simple Framework for Layer-Level KV Cache Reduction.☆46Updated 8 months ago
- Official Implementation of SAM-Decoding: Speculative Decoding via Suffix Automaton☆28Updated 4 months ago
- ☆15Updated 3 months ago
- Official implementation of ICML 2024 paper "ExCP: Extreme LLM Checkpoint Compression via Weight-Momentum Joint Shrinking".☆48Updated 11 months ago
- PipeRAG: Fast Retrieval-Augmented Generation via Algorithm-System Co-design (KDD 2025)