SqueezeAILab / SqueezedAttentionLinks

SQUEEZED ATTENTION: Accelerating Long Prompt LLM Inference
51Updated 9 months ago

Alternatives and similar repositories for SqueezedAttention

Users that are interested in SqueezedAttention are comparing it to the libraries listed below

Sorting: