hao-ai-lab / LookaheadDecodingLinks

[ICML 2024] Break the Sequential Dependency of LLM Inference Using Lookahead Decoding
1,249Updated 2 months ago

Alternatives and similar repositories for LookaheadDecoding

Users that are interested in LookaheadDecoding are comparing it to the libraries listed below

Sorting: