ROCm / aotriton
Ahead of Time (AOT) Triton Math Library
☆40Updated this week
Related projects ⓘ
Alternatives and complementary repositories for aotriton
- High-speed GEMV kernels, at most 2.7x speedup compared to pytorch baseline.☆87Updated 4 months ago
- ☆43Updated this week
- ☆156Updated last year
- ☆162Updated 4 months ago
- extensible collectives library in triton☆65Updated last month
- An efficient GPU support for LLM inference with x-bit quantization (e.g. FP6,FP5).☆196Updated 2 weeks ago
- ☆48Updated 8 months ago
- ☆47Updated 2 weeks ago
- Applied AI experiments and examples for PyTorch☆160Updated last week
- llama INT4 cuda inference with AWQ☆47Updated 4 months ago
- Simple and fast low-bit matmul kernels in CUDA / Triton☆140Updated this week
- PyTorch bindings for CUTLASS grouped GEMM.☆53Updated last week
- ☆55Updated 5 months ago
- A Python library transfers PyTorch tensors between CPU and NVMe☆96Updated this week
- Shared Middle-Layer for Triton Compilation☆188Updated this week
- A standalone GEMM kernel for fp16 activation and quantized weight, extracted from FasterTransformer☆85Updated 8 months ago
- Standalone Flash Attention v2 kernel without libtorch dependency☆98Updated 2 months ago
- Benchmark code for the "Online normalizer calculation for softmax" paper☆59Updated 6 years ago
- ☆145Updated this week
- Unified compiler/runtime for interfacing with PyTorch Dynamo.☆95Updated this week
- A collection of memory efficient attention operators implemented in the Triton language.☆217Updated 5 months ago
- ☆11Updated last month
- Development repository for the Triton language and compiler☆93Updated this week
- Benchmark scripts for TVM☆73Updated 2 years ago
- Assembler for NVIDIA Volta and Turing GPUs☆200Updated 2 years ago
- OpenAI Triton backend for Intel® GPUs☆143Updated this week
- ☆67Updated last year
- ☆88Updated 2 months ago
- An experimental CPU backend for Triton (https//github.com/openai/triton)☆35Updated 5 months ago
- A Fusion Code Generator for NVIDIA GPUs (commonly known as "nvFuser")☆268Updated this week