KaiLv69 / DuoDecodingLinks

DuoDecoding: Hardware-aware Heterogeneous Speculative Decoding with Dynamic Multi-Sequence Drafting
14Updated 3 months ago

Alternatives and similar repositories for DuoDecoding

Users that are interested in DuoDecoding are comparing it to the libraries listed below

Sorting: