infinigence / SpecEELinks

Repo for SpecEE: Accelerating Large Language Model Inference with Speculative Early Exiting (ISCA25)
36Updated last month

Alternatives and similar repositories for SpecEE

Users that are interested in SpecEE are comparing it to the libraries listed below

Sorting: