ASISys / Adrenaline

Injecting Adrenaline into LLM Serving: Boosting Resource Utilization and Throughput via Attention Disaggregation
19Updated last month

Alternatives and similar repositories for Adrenaline

Users that are interested in Adrenaline are comparing it to the libraries listed below

Sorting: