hemingkx / SpecDec

Codes for our paper "Speculative Decoding: Exploiting Speculative Execution for Accelerating Seq2seq Generation" (EMNLP 2023 Findings)
39Updated last year

Alternatives and similar repositories for SpecDec:

Users that are interested in SpecDec are comparing it to the libraries listed below