jundaf2 / eigenMHALinks
Forward and backward Attention DNN operators implementationed by LibTorch, cuDNN, and Eigen.
☆30Updated 2 years ago
Alternatives and similar repositories for eigenMHA
Users that are interested in eigenMHA are comparing it to the libraries listed below
Sorting:
- Swin Transformer C++ Implementation☆63Updated 4 years ago
- Several optimization methods of half-precision general matrix vector multiplication (HGEMV) using CUDA core.☆63Updated 11 months ago
- Performance of the C++ interface of flash attention and flash attention v2 in large language model (LLM) inference scenarios.☆16Updated last year
- Benchmark code for the "Online normalizer calculation for softmax" paper☆96Updated 7 years ago
- ☆129Updated 8 months ago
- High-speed GEMV kernels, at most 2.7x speedup compared to pytorch baseline.☆113Updated last year
- ☆37Updated last year
- CUDA Matrix Multiplication Optimization☆214Updated last year
- A Winograd Minimal Filter Implementation in CUDA☆25Updated 3 years ago
- ☆67Updated 7 months ago
- We invite you to visit and follow our new repository at https://github.com/microsoft/TileFusion. TiledCUDA is a highly efficient kernel …☆183Updated 6 months ago
- how to design cpu gemm on x86 with avx256, that can beat openblas.☆71Updated 6 years ago
- Several optimization methods of half-precision general matrix multiplication (HGEMM) using tensor core with WMMA API and MMA PTX instruct…☆452Updated 11 months ago
- ☆228Updated last year
- A simple high performance CUDA GEMM implementation.☆392Updated last year
- ☆104Updated 4 months ago
- ☆113Updated last year
- Matrix Multiply-Accumulate with CUDA and WMMA( Tensor Core)☆138Updated 4 years ago
- Step-by-step optimization of CUDA SGEMM☆363Updated 3 years ago
- Examples of CUDA implementations by Cutlass CuTe☆218Updated last month
- 用C++实现一个简单的Transformer模型。 Attention Is All You Need。☆48Updated 4 years ago
- A library of GPU kernels for sparse matrix operations.☆270Updated 4 years ago
- row-major matmul optimization☆649Updated last year
- ☆149Updated 7 months ago
- play gemm with tvm☆91Updated 2 years ago
- CPU Memory Compiler and Parallel programing☆26Updated 8 months ago
- Yinghan's Code Sample☆341Updated 3 years ago
- A tutorial for CUDA&PyTorch☆150Updated 6 months ago
- cuDNN sample codes provided by Nvidia☆46Updated 6 years ago
- Optimizing SGEMM kernel functions on NVIDIA GPUs to a close-to-cuBLAS performance.☆371Updated 7 months ago