DD-DuDa / Cute-Learning
Examples of CUDA implementations by Cutlass CuTe
☆86Updated this week
Related projects ⓘ
Alternatives and complementary repositories for Cute-Learning
- 使用 cutlass 仓库在 ada 架构上实现 fp8 的 flash attention☆52Updated 3 months ago
- ☆78Updated 8 months ago
- ☆79Updated last year
- TiledCUDA is a highly efficient kernel template library designed to elevate CUDA C’s level of abstraction for processing tiles.☆148Updated this week
- ☆109Updated 2 years ago
- A Easy-to-understand TensorOp Matmul Tutorial☆288Updated last month
- ☆103Updated 7 months ago
- play gemm with tvm☆84Updated last year
- ☆51Updated 2 years ago
- ☆22Updated 6 months ago
- A standalone GEMM kernel for fp16 activation and quantized weight, extracted from FasterTransformer☆85Updated 8 months ago
- Several optimization methods of half-precision general matrix vector multiplication (HGEMV) using CUDA core.☆48Updated 2 months ago
- ☆47Updated 2 weeks ago
- Magicube is a high-performance library for quantized sparse matrix operations (SpMM and SDDMM) of deep learning on Tensor Cores.☆81Updated last year
- ☆136Updated this week
- flash attention tutorial written in python, triton, cuda, cutlass☆195Updated 4 months ago
- Performance of the C++ interface of flash attention and flash attention v2 in large language model (LLM) inference scenarios.☆26Updated 2 months ago
- ☆79Updated 2 months ago
- ☆162Updated 4 months ago
- Standalone Flash Attention v2 kernel without libtorch dependency☆98Updated 2 months ago
- ☆97Updated 7 months ago
- hands on model tuning with TVM and profile it on a Mac M1, x86 CPU, and GTX-1080 GPU.☆39Updated last year
- Several optimization methods of half-precision general matrix multiplication (HGEMM) using tensor core with WMMA API and MMA PTX instruct…☆296Updated 2 months ago
- ☆32Updated last month
- ☆56Updated this week
- llama INT4 cuda inference with AWQ☆47Updated 4 months ago
- High-speed GEMV kernels, at most 2.7x speedup compared to pytorch baseline.☆87Updated 3 months ago
- Tutorials of Extending and importing TVM with CMAKE Include dependency.☆10Updated last month
- ☆142Updated last year
- This project is about convolution operator optimization on GPU, include GEMM based (Implicit GEMM) convolution.☆18Updated last month