zhengzangw / Sequence-SchedulingLinks

PyTorch implementation of paper "Response Length Perception and Sequence Scheduling: An LLM-Empowered LLM Inference Pipeline".
86Updated 2 years ago

Alternatives and similar repositories for Sequence-Scheduling

Users that are interested in Sequence-Scheduling are comparing it to the libraries listed below

Sorting: