lucidrains / speculative-decoding

Explorations into some recent techniques surrounding speculative decoding
250Updated 3 months ago

Alternatives and similar repositories for speculative-decoding:

Users that are interested in speculative-decoding are comparing it to the libraries listed below