Infini-AI-Lab / TriForceLinks

[COLM 2024] TriForce: Lossless Acceleration of Long Sequence Generation with Hierarchical Speculative Decoding
261Updated 11 months ago

Alternatives and similar repositories for TriForce

Users that are interested in TriForce are comparing it to the libraries listed below

Sorting: