MagellaX / StreamAttnLinks

A high-performance attention mechanism that computes softmax normalization in a single streaming pass using running accumulators (online softmax).
26Updated last month

Alternatives and similar repositories for StreamAttn

Users that are interested in StreamAttn are comparing it to the libraries listed below

Sorting: