lucidrains / speculative-decoding

Explorations into some recent techniques surrounding speculative decoding
209Updated last year

Related projects

Alternatives and complementary repositories for speculative-decoding