Infini-AI-Lab / TriForceLinks

[COLM 2024] TriForce: Lossless Acceleration of Long Sequence Generation with Hierarchical Speculative Decoding
251Updated 9 months ago

Alternatives and similar repositories for TriForce

Users that are interested in TriForce are comparing it to the libraries listed below

Sorting: