KaiLv69 / DuoDecodingView on GitHub
DuoDecoding: Hardware-aware Heterogeneous Speculative Decoding with Dynamic Multi-Sequence Drafting
17Mar 4, 2025Updated 11 months ago

Alternatives and similar repositories for DuoDecoding

Users that are interested in DuoDecoding are comparing it to the libraries listed below

Sorting:

Are these results useful?