Alternatives and similar repositories for triton-kernels:

Users that are interested in triton-kernels are comparing it to the libraries listed below

• timudk / flux_triton
  Writing FLUX in Triton
  ☆32Updated 4 months ago
• cloneofsimo / ezmup
  Simple implementation of muP, based on Spectral Condition for Feature Learning. The implementation is SGD only, dont use it for Adam
  ☆73Updated 6 months ago
• cloneofsimo / imagenet.int8
  ☆37Updated 9 months ago
• aredden / torch-bnb-fp4
  Faster Pytorch bitsandbytes 4bit fp4 nn.Linear ops
  ☆26Updated 10 months ago
• aredden / torch-cublas-hgemm
  PyTorch half precision gemm lib w/ fused optional bias + optional relu/gelu
  ☆52Updated 2 months ago
• bentherien / mu_learned_optimization
  [Oral; Neurips OPT2024 ] μLO: Compute-Efficient Meta-Generalization of Learned Optimizers
  ☆11Updated 2 months ago
• amirzandieh / HyperAttention
  Triton Implementation of HyperAttention Algorithm
  ☆46Updated last year
• GindaChen / FlexFlashAttention3
  FlexAttention w/ FlashAttention3 Support
  ☆26Updated 4 months ago
• graphcore-research / out-of-the-box-fp8-training
  Demo of the unit_scaling library, showing how a model can be easily adapted to train in FP8.
  ☆43Updated 6 months ago
• mgmalek / efficient_cross_entropy
  ☆88Updated 8 months ago
• fal-ai / diffusion-speedrun
  Focused on fast experimentation and simplicity
  ☆65Updated last month
• sekstini / basedxl
  ☆16Updated 10 months ago
• cloneofsimo / zeroshampoo
  ☆33Updated 5 months ago
• fal-ai-community / minDDPD
  ☆31Updated last month
• brianfitzgerald / jax-mmdit
  Implementation of Diffusion Transformers and Rectified Flow in Jax
  ☆21Updated 7 months ago
• cloneofsimo / efae
  ☆21Updated 7 months ago
• cloneofsimo / min-max-in-dit
  ☆26Updated 9 months ago
• renll / SeqBoat
  [NeurIPS 2023] Sparse Modular Activation for Efficient Sequence Modeling
  ☆35Updated last year
• cloneofsimo / insightful-nn-papers
  These papers will provide unique insightful concepts that will broaden your perspective on neural networks and deep learning
  ☆47Updated last year
• cloneofsimo / repa-rf
  ☆32Updated 3 months ago
• cloneofsimo / min-fsdp
  ☆75Updated 7 months ago
• DeepAuto-AI / hip-attention
  Training-free Post-training Efficient Sub-quadratic Complexity Attention. Implemented with OpenAI Triton.
  ☆55Updated this week
• srush / triton-autodiff
  Experiment of using Tangent to autodiff triton
  ☆75Updated last year
• ahennequ / pytorch-custom-mma
  ☆29Updated 2 years ago
• IST-DASLab / SparseFinetuning
  Repository for Sparse Finetuning of LLMs via modified version of the MosaicML llmfoundry
  ☆40Updated last year
• lernapparat / torchhacks
  Hacks for PyTorch
  ☆18Updated last year
• cloneofsimo / karras-power-ema-tutorial
  ☆51Updated last year
• tridao / flash-attention-wheels
  ☆45Updated last year
• yandex-research / vqdm
  Official repository for VQDM:Accurate Compression of Text-to-Image Diffusion Models via Vector Quantization paper
  ☆32Updated 4 months ago