thunlp / Ouroboros

Ouroboros: Speculative Decoding with Large Model Enhanced Drafting (EMNLP 2024 main)
90Updated last week

Alternatives and similar repositories for Ouroboros:

Users that are interested in Ouroboros are comparing it to the libraries listed below