ai-compiler-study / triton-kernelsLinks
Triton kernels for Flux
☆22Updated 7 months ago
Alternatives and similar repositories for triton-kernels
Users that are interested in triton-kernels are comparing it to the libraries listed below
Sorting:
- Writing FLUX in Triton☆41Updated last year
- [WIP] Better (FP8) attention for Hopper☆32Updated 11 months ago
- ☆124Updated last year
- ☆79Updated last year
- PyTorch half precision gemm lib w/ fused optional bias + optional relu/gelu☆78Updated last year
- Simple implementation of muP, based on Spectral Condition for Feature Learning. The implementation is SGD only, dont use it for Adam☆85Updated last year
- 🎬 3.7× faster video generation E2E 🖼️ 1.6× faster image generation E2E ⚡ ColumnSparseAttn 9.3× vs FlashAttn‑3 💨 ColumnSparseGEMM 2.5× …☆101Updated 5 months ago
- FlexAttention w/ FlashAttention3 Support☆27Updated last year
- Focused on fast experimentation and simplicity☆80Updated last year
- research impl of Native Sparse Attention (2502.11089)☆63Updated 11 months ago
- Implementation of Diffusion Transformers and Rectified Flow in Jax☆27Updated last year
- ring-attention experiments☆165Updated last year
- ☆44Updated 3 months ago
- Experiment of using Tangent to autodiff triton☆82Updated 2 years ago
- Faster Pytorch bitsandbytes 4bit fp4 nn.Linear ops☆30Updated last year
- BFloat16 Fused Adam Operator for PyTorch☆16Updated last year
- ☆92Updated last year
- ☆18Updated last year
- Triton Implementation of HyperAttention Algorithm☆48Updated 2 years ago
- These papers will provide unique insightful concepts that will broaden your perspective on neural networks and deep learning☆48Updated 2 years ago
- ☆34Updated last year
- The source code of our work "Prepacking: A Simple Method for Fast Prefilling and Increased Throughput in Large Language Models" [AISTATS …☆60Updated last year
- Boosting 4-bit inference kernels with 2:4 Sparsity☆93Updated last year
- Make triton easier☆50Updated last year
- This repository contains the experimental PyTorch native float8 training UX☆226Updated last year
- ☆18Updated last year
- supporting pytorch FSDP for optimizers☆84Updated last year
- Making Flux go brrr on GPUs.☆161Updated last month
- Prototype routines for GPU quantization written using PyTorch.☆21Updated this week
- A block oriented training approach for inference time optimization.☆34Updated last year