sandeepkumar-skb / pytorch_custom_op
End to End steps for adding custom ops in PyTorch.
☆19Updated 4 years ago
Related projects ⓘ
Alternatives and complementary repositories for pytorch_custom_op
- ☆48Updated this week
- TiledCUDA is a highly efficient kernel template library designed to elevate CUDA C’s level of abstraction for processing tiles.☆154Updated this week
- extensible collectives library in triton☆71Updated last month
- Fairring (FAIR + Herring) is a plug-in for PyTorch that provides a process group for distributed training that outperforms NCCL at large …☆63Updated 2 years ago
- An experimental CPU backend for Triton (https//github.com/openai/triton)☆35Updated 6 months ago
- An extension library of WMMA API (Tensor Core API)☆84Updated 4 months ago
- High-speed GEMV kernels, at most 2.7x speedup compared to pytorch baseline.☆90Updated 4 months ago
- ☆167Updated 4 months ago
- CUTLASS and CuTe Examples☆13Updated this week
- A Fusion Code Generator for NVIDIA GPUs (commonly known as "nvFuser")☆270Updated this week
- ☆73Updated last year
- Benchmark code for the "Online normalizer calculation for softmax" paper☆59Updated 6 years ago
- A standalone GEMM kernel for fp16 activation and quantized weight, extracted from FasterTransformer☆85Updated 8 months ago
- Standalone Flash Attention v2 kernel without libtorch dependency☆98Updated 2 months ago
- ☆80Updated 7 months ago
- Tacker: Tensor-CUDA Core Kernel Fusion for Improving the GPU Utilization while Ensuring QoS☆17Updated 2 years ago
- MatMul Performance Benchmarks for a Single CPU Core comparing both hand engineered and codegen kernels.☆124Updated last year
- An experimental CPU backend for Triton☆56Updated last week
- ☆128Updated this week
- CUDA Matrix Multiplication Optimization☆141Updated 4 months ago
- SparseTIR: Sparse Tensor Compiler for Deep Learning☆131Updated last year
- Home for OctoML PyTorch Profiler☆107Updated last year
- Use tensor core to calculate back-to-back HGEMM (half-precision general matrix multiplication) with MMA PTX instruction.☆11Updated last year
- Matrix Multiply-Accumulate with CUDA and WMMA( Tensor Core)☆115Updated 4 years ago
- ☆48Updated 8 months ago
- Shared Middle-Layer for Triton Compilation☆191Updated this week
- An extention of TVMScript to write simple and high performance GPU kernels with tensorcore.☆49Updated 3 months ago
- ☆38Updated 4 years ago
- ☆31Updated last year
- Benchmarks to capture important workloads.☆28Updated 5 months ago