feifeibear / LLMSpeculativeSamplingLinks

Fast inference from large lauguage models via speculative decoding
β˜†807Updated last year

Alternatives and similar repositories for LLMSpeculativeSampling

Users that are interested in LLMSpeculativeSampling are comparing it to the libraries listed below

Sorting: