lucidrains / speculative-decoding

Explorations into some recent techniques surrounding speculative decoding
211Updated last year

Related projects

Alternatives and complementary repositories for speculative-decoding