pytorch-labs / attention-gymLinks
Helpful tools and examples for working with flex-attention
β831Updated last week
Alternatives and similar repositories for attention-gym
Users that are interested in attention-gym are comparing it to the libraries listed below
Sorting:
- Muon: An optimizer for hidden layers in neural networksβ897Updated last week
- Implementation of π Ring Attention, from Liu et al. at Berkeley AI, in Pytorchβ519Updated last month
- A subset of PyTorch's neural network modules, written in Python using OpenAI's Triton.β554Updated this week
- Large Context Attentionβ716Updated 4 months ago
- Ring attention implementation with flash attention