alexzhang13 / Triton-Puzzles-SolutionsLinks
Personal solutions to the Triton Puzzles
☆20Updated last year
Alternatives and similar repositories for Triton-Puzzles-Solutions
Users that are interested in Triton-Puzzles-Solutions are comparing it to the libraries listed below
Sorting:
- Experiment of using Tangent to autodiff triton☆81Updated 2 years ago
- A bunch of kernels that might make stuff slower 😉☆75Updated this week
- FlexAttention w/ FlashAttention3 Support☆27Updated last year
- extensible collectives library in triton☆93Updated 9 months ago
- Triton-based Symmetric Memory operators and examples☆79Updated last week
- The evaluation framework for training-free sparse attention in LLMs☆110Updated 3 months ago
- ☆28Updated last year
- Write a fast kernel and run it on Discord. See how you compare against the best!☆68Updated this week
- ring-attention experiments☆163Updated last year
- Fast and memory-efficient exact attention☆75Updated 10 months ago
- Demo of the unit_scaling library, showing how a model can be easily adapted to train in FP8.☆46Updated last year
- ☆23Updated 8 months ago
- train with kittens!☆63Updated last year
- ☆133Updated 7 months ago
- ☆115Updated last year
- Make triton easier☆50Updated last year
- A place to store reusable transformer components of my own creation or found on the interwebs☆70Updated 2 weeks ago
- ☆92Updated last year
- JaxPP is a library for JAX that enables flexible MPMD pipeline parallelism for large-scale LLM training☆63Updated this week
- ☆44Updated 2 months ago
- Ship correct and fast LLM kernels to PyTorch☆135Updated last week
- Tree Attention: Topology-aware Decoding for Long-Context Attention on GPU clusters☆131Updated last year
- Using FlexAttention to compute attention with different masking patterns☆47Updated last year
- CUDA and Triton implementations of Flash Attention with SoftmaxN.☆73Updated last year
- Accelerate LLM preference tuning via prefix sharing with a single line of code☆51Updated 6 months ago
- The simplest implementation of recent Sparse Attention patterns for efficient LLM inference.☆92Updated 6 months ago
- ☆127Updated this week
- ☆15Updated 2 months ago
- ☆27Updated 2 years ago
- Awesome Triton Resources☆39Updated 9 months ago