Infini-AI-Lab / Sequoia

scalable and robust tree-based speculative decoding algorithm
336Updated last month

Alternatives and similar repositories for Sequoia:

Users that are interested in Sequoia are comparing it to the libraries listed below