Alternatives and similar repositories for triton-llvm-releases

Users that are interested in triton-llvm-releases are comparing it to the libraries listed below

• TiledTensor / TiledBench
  Benchmark tests supporting the TiledCUDA library.
  ☆18Updated last year
• GindaChen / FlexFlashAttention3
  FlexAttention w/ FlashAttention3 Support
  ☆27Updated last year
• Harry-Chen / InfMoE
  Inference framework for MoE layers based on TensorRT with Python binding
  ☆41Updated 4 years ago
• iree-org / iree-nvgpu
  ☆50Updated last year
• NVIDIA / HMM_sample_code
  CUDA 12.2 HMM demos
  ☆20Updated last year
• manishucsd / py-codegen
  ☆16Updated last year
• LeiWang1999 / AutoGPTQ.tvm
  GPTQ inference TVM kernel
  ☆41Updated last year
• habanero-lab / APPy
  APPy (Annotated Parallelism for Python) enables users to annotate loops and tensor expressions in Python with compiler directives akin to…
  ☆27Updated this week
• IBM / triton-dejavu
  Framework to reduce autotune overhead to zero for well known deployments.
  ☆91Updated 3 months ago
• meta-pytorch / tlparse
  TORCH_LOGS parser for PT2
  ☆70Updated last month
• microsoft / TileFusion
  TileFusion is an experimental C++ macro kernel template library that elevates the abstraction level in CUDA C for tile processing.
  ☆104Updated 5 months ago
• facebookresearch / fairring
  Fairring (FAIR + Herring) is a plug-in for PyTorch that provides a process group for distributed training that outperforms NCCL at large …
  ☆65Updated 3 years ago
• facebookexperimental / protoquant
  Prototype routines for GPU quantization written using PyTorch.
  ☆21Updated 4 months ago
• Aleph-Alpha-Research / NeurIPS-WANT-submission-efficient-parallelization-layouts
  ☆22Updated 2 years ago
• deepspeedai / DeepSpeed-Kernels
  ☆71Updated 9 months ago
• thuml / learn_torch.compile
  torch.compile artifacts for common deep learning models, can be used as a learning resource for torch.compile
  ☆18Updated 2 years ago
• tlc-pack / libflash_attn
  Standalone Flash Attention v2 kernel without libtorch dependency
  ☆112Updated last year
• NVIDIA / free-threaded-python
  No-GIL Python environment featuring NVIDIA Deep Learning libraries.
  ☆69Updated 8 months ago
• hazan-lab / flash-stu
  PyTorch implementation of the Flash Spectral Transform Unit.
  ☆21Updated last year
• DeMoriarty / custom_matmul_kernels
  Customized matrix multiplication kernels
  ☆57Updated 3 years ago
• ROCm / aotriton
  Ahead of Time (AOT) Triton Math Library
  ☆84Updated 2 weeks ago
• microsoft / torchy
  A tracing JIT for PyTorch
  ☆17Updated 3 years ago
• megvii-research / IntLLaMA
  IntLLaMA: A fast and light quantization solution for LLaMA
  ☆18Updated 2 years ago
• wangsiping97 / FastGEMV
  High-speed GEMV kernels, at most 2.7x speedup compared to pytorch baseline.
  ☆123Updated last year
• softmax1 / Flash-Attention-Softmax-N
  CUDA and Triton implementations of Flash Attention with SoftmaxN.
  ☆73Updated last year
• Dao-AILab / gemm-cublas
  ☆23Updated 7 months ago
• triton-lang / kernels
  ☆99Updated last year
• cchan / tccl
  extensible collectives library in triton
  ☆91Updated 8 months ago
• hpcaitech / TensorNVMe
  A Python library transfers PyTorch tensors between CPU and NVMe
  ☆123Updated last year
• UmerHA / triton_util
  Make triton easier
  ☆49Updated last year