hemingkx / SpecDec

Codes for our paper "Speculative Decoding: Exploiting Speculative Execution for Accelerating Seq2seq Generation" (EMNLP 2023 Findings)
33Updated 11 months ago

Related projects

Alternatives and complementary repositories for SpecDec