Doraemonzzz / Awesome-Triton-ResourcesLinks
Awesome Triton Resources
☆31Updated last month
Alternatives and similar repositories for Awesome-Triton-Resources
Users that are interested in Awesome-Triton-Resources are comparing it to the libraries listed below
Sorting:
- Simple and efficient pytorch-native transformer training and inference (batched)☆76Updated last year
- Here we will test various linear attention designs.☆59Updated last year
- ☆48Updated last year
- ☆114Updated 3 weeks ago
- CUDA and Triton implementations of Flash Attention with SoftmaxN.☆70Updated last year
- The evaluation framework for training-free sparse attention in LLMs☆69Updated this week
- Transformers components but in Triton☆34Updated last month
- The simplest implementation of recent Sparse Attention patterns for efficient LLM inference.☆70Updated last week
- ☆55Updated 11 months ago
- ☆21Updated 3 months ago
- Flash-Muon: An Efficient Implementation of Muon Optimizer☆131Updated last week
- Using FlexAttention to compute attention with different masking patterns☆44Updated 9 months ago
- RADLADS training code☆24Updated last month
- Experiment of using Tangent to autodiff triton☆79Updated last year
- ☆22Updated last year
- ☆31Updated last year
- ☆76Updated 3 months ago
- ☆36Updated 2 months ago
- Stick-breaking attention☆57Updated last week
- The official implementation for Gated Attention for Large Language Models: Non-linearity, Sparsity, and Attention-Sink-Free☆44Updated last month
- A toolkit for scaling law research ⚖☆49Updated 4 months ago
- My Implementation of Q-Sparse: All Large Language Models can be Fully Sparsely-Activated☆32Updated 10 months ago
- FlexAttention w/ FlashAttention3 Support☆26Updated 8 months ago
- A fusion of a linear layer and a cross entropy loss, written for pytorch in triton.☆68Updated 10 months ago
- Parallel Associative Scan for Language Models☆18Updated last year
- APPy (Annotated Parallelism for Python) enables users to annotate loops and tensor expressions in Python with compiler directives akin to…☆23Updated this week
- Fast and memory-efficient exact attention☆68Updated 3 months ago
- ☆14Updated last month
- 🔥 A minimal training framework for scaling FLA models☆170Updated last week
- Repository for Sparse Finetuning of LLMs via modified version of the MosaicML llmfoundry☆42Updated last year