hyx1999 / SAM-DecodingLinks
Official Implementation of SAM-Decoding: Speculative Decoding via Suffix Automaton
☆31Updated 6 months ago
Alternatives and similar repositories for SAM-Decoding
Users that are interested in SAM-Decoding are comparing it to the libraries listed below
Sorting:
- The official implementation of paper: SimLayerKV: A Simple Framework for Layer-Level KV Cache Reduction.☆48Updated 10 months ago
- ☆117Updated 2 months ago
- [ICLR 2025] SWIFT: On-the-Fly Self-Speculative Decoding for LLM Inference Acceleration☆52Updated 6 months ago
- Ouroboros: Speculative Decoding with Large Model Enhanced Drafting (EMNLP 2024 main)☆109Updated 5 months ago
- LongSpec: Long-Context Lossless Speculative Decoding with Efficient Drafting and Verification☆62Updated last month
- ☆41Updated 3 months ago
- [NeurIPS 2024] Fast Best-of-N Decoding via Speculative Rejection☆51Updated 9 months ago
- Multi-Candidate Speculative Decoding☆36Updated last year
- ☆45Updated 9 months ago
- [ICLR 2025] TidalDecode: A Fast and Accurate LLM Decoding with Position Persistent Sparse Attention