Infini-AI-Lab / MagicDecLinks

[ICLR2025] Breaking Throughput-Latency Trade-off for Long Sequences with Speculative Decoding
130Updated 10 months ago

Alternatives and similar repositories for MagicDec

Users that are interested in MagicDec are comparing it to the libraries listed below

Sorting: