infinigence / SpecEELinks

Repo for SpecEE: Accelerating Large Language Model Inference with Speculative Early Exiting (ISCA25)
37Updated 2 months ago

Alternatives and similar repositories for SpecEE

Users that are interested in SpecEE are comparing it to the libraries listed below

Sorting: