Doraemonzzz / Awesome-Triton-ResourcesLinks
Awesome Triton Resources
☆28Updated last month
Alternatives and similar repositories for Awesome-Triton-Resources
Users that are interested in Awesome-Triton-Resources are comparing it to the libraries listed below
Sorting:
- Transformers components but in Triton☆33Updated 3 weeks ago
- Using FlexAttention to compute attention with different masking patterns☆43Updated 8 months ago
- Here we will test various linear attention designs.☆58Updated last year
- ☆53Updated this week
- Simple and efficient pytorch-native transformer training and inference (batched)☆75Updated last year
- Official implementation of "The Sparse Frontier: Sparse Attention Trade-offs in Transformer LLMs"☆32Updated last month
- Flash-Muon: An Efficient Implementation of Muon Optimizer☆115Updated this week
- ☆22Updated last year
- ☆54Updated 10 months ago
- Fast and memory-efficient exact attention☆68Updated 3 months ago
- Stick-breaking attention☆56Updated 2 months ago
- CUDA and Triton implementations of Flash Attention with SoftmaxN.☆70Updated last year
- The simplest implementation of recent Sparse Attention patterns for efficient LLM inference.☆62Updated 4 months ago
- Triton Implementation of HyperAttention Algorithm☆48Updated last year
- The official implementation for Gated Attention for Large Language Models: Non-linearity, Sparsity, and Attention-Sink-Free☆38Updated 3 weeks ago
- FlexAttention w/ FlashAttention3 Support☆26Updated 8 months ago
- ☆46Updated last year
- ☆74Updated 3 months ago
- ☆21Updated 2 months ago
- DPO, but faster 🚀☆42Updated 5 months ago
- Experiment of using Tangent to autodiff triton☆79Updated last year
- APPy (Annotated Parallelism for Python) enables users to annotate loops and tensor expressions in Python with compiler directives akin to…☆23Updated 2 weeks ago
- Code for the paper: https://arxiv.org/pdf/2309.06979.pdf☆19Updated 10 months ago
- Accelerate LLM preference tuning via prefix sharing with a single line of code☆41Updated last month
- ☆31Updated last year
- ☆37Updated last year
- Official repository of paper "RNNs Are Not Transformers (Yet): The Key Bottleneck on In-context Retrieval"☆27Updated last year
- ☆31Updated last year
- ☆52Updated last year
- This repo is based on https://github.com/jiaweizzhao/GaLore☆28Updated 8 months ago