MARD1NO / CUDA-PPT
☆87Updated last year
Alternatives and similar repositories for CUDA-PPT:
Users that are interested in CUDA-PPT are comparing it to the libraries listed below
- play gemm with tvm☆89Updated last year
- Performance of the C++ interface of flash attention and flash attention v2 in large language model (LLM) inference scenarios.☆35Updated 3 weeks ago
- ☆145Updated 2 months ago
- Examples of CUDA implementations by Cutlass CuTe☆145Updated last month
- 使用 cutlass 仓库在 ada 架构上实现 fp8 的 flash attention☆60Updated 7 months ago
- ☆110Updated 3 months ago
- ☆36Updated 5 months ago
- ☆113Updated last year
- ☆134Updated 2 months ago
- ☆139Updated 11 months ago
- We invite you to visit and follow our new repository at https://github.com/microsoft/TileFusion. TiledCUDA is a highly efficient kernel …☆178Updated last month
- ☆87Updated 6 months ago
- A standalone GEMM kernel for fp16 activation and quantized weight, extracted from FasterTransformer☆89Updated 3 weeks ago
- code reading for tvm☆75Updated 3 years ago
- ☆87Updated last week
- A Easy-to-understand TensorOp Matmul Tutorial☆327Updated 6 months ago
- ☆109Updated 11 months ago
- An unofficial cuda assembler, for all generations of SASS, hopefully :)☆82Updated 2 years ago
- ☆59Updated 2 months ago
- Benchmark code for the "Online normalizer calculation for softmax" paper☆85Updated 6 years ago
- A benchmark suited especially for deep learning operators☆42Updated 2 years ago
- ☆29Updated 11 months ago
- Standalone Flash Attention v2 kernel without libtorch dependency☆106Updated 6 months ago
- 使用 cutlass 实现 flash-attention 精简版,具有教学意义☆38Updated 7 months ago
- Several optimization methods of half-precision general matrix vector multiplication (HGEMV) using CUDA core.☆57Updated 6 months ago
- Implement Flash Attention using Cute.☆71Updated 3 months ago
- Triton Compiler related materials.☆28Updated 2 months ago
- ☆58Updated 4 months ago
- ⚡️Write HGEMM from scratch using Tensor Cores with WMMA, MMA and CuTe API, Achieve Peak⚡️ Performance.☆59Updated 2 weeks ago
- ☆37Updated 2 years ago