sandeepkumar-skb / pytorch_custom_op
End to End steps for adding custom ops in PyTorch.
☆22Updated 4 years ago
Alternatives and similar repositories for pytorch_custom_op:
Users that are interested in pytorch_custom_op are comparing it to the libraries listed below
- ☆96Updated last year
- TileFusion is an experimental C++ macro kernel template library that elevates the abstraction level in CUDA C for tile processing.☆84Updated last week
- An extension library of WMMA API (Tensor Core API)☆96Updated 9 months ago
- extensible collectives library in triton☆86Updated last month
- ☆70Updated 4 months ago
- MLIR-based partitioning system☆82Updated this week
- DeeperGEMM: crazy optimized version☆68Updated this week
- ☆78Updated 6 months ago
- High-speed GEMV kernels, at most 2.7x speedup compared to pytorch baseline.☆106Updated 9 months ago
- A standalone GEMM kernel for fp16 activation and quantized weight, extracted from FasterTransformer☆91Updated this week
- Standalone Flash Attention v2 kernel without libtorch dependency☆108Updated 7 months ago
- ☆104Updated last month
- ⚡️Write HGEMM from scratch using Tensor Cores with WMMA, MMA and CuTe API, Achieve Peak⚡️ Performance.☆74Updated last month
- We invite you to visit and follow our new repository at https://github.com/microsoft/TileFusion. TiledCUDA is a highly efficient kernel …☆181Updated 3 months ago
- ☆30Updated this week
- ☆79Updated 2 years ago
- A lightweight design for computation-communication overlap.☆67Updated last week
- Several optimization methods of half-precision general matrix vector multiplication (HGEMV) using CUDA core.☆61Updated 8 months ago
- A Python-embedded DSL that makes it easy to write fast, scalable ML kernels with minimal boilerplate.☆102Updated this week
- Benchmark code for the "Online normalizer calculation for softmax" paper☆91Updated 6 years ago
- ☆57Updated last week
- ☆202Updated 9 months ago
- A tool for examining GPU scheduling behavior.☆81Updated 8 months ago
- A Vectorized N:M Format for Unleashing the Power of Sparse Tensor Cores☆51Updated last year
- Matrix Multiply-Accumulate with CUDA and WMMA( Tensor Core)☆131Updated 4 years ago
- An extention of TVMScript to write simple and high performance GPU kernels with tensorcore.☆50Updated 9 months ago
- An experimental CPU backend for Triton (https//github.com/openai/triton)☆40Updated last month
- CUTLASS and CuTe Examples☆48Updated 4 months ago
- Multi-GPU communication profiler and visualizer☆29Updated 10 months ago
- rocSHMEM intra-kernel networking runtime for AMD dGPUs on the ROCm platform.☆80Updated this week