siboehm / SGEMM_CUDA

Related projects ⓘ

Alternatives and complementary repositories for SGEMM_CUDA

• wangzyon / NVIDIA_SGEMM_PRACTICE
  Step-by-step optimization of CUDA SGEMM
  ☆225Updated 2 years ago
• Bruce-Lee-LY / cuda_hgemm
  Several optimization methods of half-precision general matrix multiplication (HGEMM) using tensor core with WMMA API and MMA PTX instruct…
  ☆296Updated 2 months ago
• KnowingNothing / MatmulTutorial
  A Easy-to-understand TensorOp Matmul Tutorial
  ☆287Updated last month
• ColfaxResearch / cutlass-kernels
  ☆162Updated 3 months ago
• leimao / CUDA-GEMM-Optimization
  CUDA Matrix Multiplication Optimization
  ☆139Updated 3 months ago
• Cjkkkk / CUDA_gemm
  A simple high performance CUDA GEMM implementation.
  ☆334Updated 10 months ago
• yzhaiustc / Optimizing-SGEMM-on-NVIDIA-Turing-GPUs
  Optimizing SGEMM kernel functions on NVIDIA GPUs to a close-to-cuBLAS performance.
  ☆276Updated 2 years ago
• te42kyfo / gpu-benches
  collection of benchmarks to measure basic GPU capabilities
  ☆264Updated 4 months ago
• microsoft / triton-shared
  Shared Middle-Layer for Triton Compilation
  ☆185Updated this week
• Yinghan-Li / YHs_Sample
  Yinghan's Code Sample
  ☆284Updated 2 years ago
• cloudcores / CuAssembler
  An unofficial cuda assembler, for all generations of SASS, hopefully ：）
  ☆401Updated last year
• NVIDIA / Fuser
  A Fusion Code Generator for NVIDIA GPUs (commonly known as "nvFuser")
  ☆268Updated this week
• mirage-project / mirage
  Mirage: Automatically Generating Fast GPU Kernels without Programming in Triton/CUDA
  ☆597Updated this week
• daadaada / turingas
  Assembler for NVIDIA Volta and Turing GPUs
  ☆200Updated 2 years ago
• google-research / sputnik
  A library of GPU kernels for sparse matrix operations.
  ☆246Updated 3 years ago
• bytedance / flux
  A fast communication-overlapping library for tensor parallelism on GPUs.
  ☆217Updated last week
• NVIDIA / nvbench
  CUDA Kernel Benchmarking Library
  ☆513Updated 2 weeks ago
• tspeterkim / flash-attention-minimal
  Flash Attention in ~100 lines of CUDA (forward pass only)
  ☆609Updated 7 months ago
• ROCm / composable_kernel
  Composable Kernel: Performance Portable Programming Model for Machine Learning Tensor Operators
  ☆309Updated this week
• NVIDIA / TensorRT-Incubator
  Experimental projects related to TensorRT
  ☆77Updated this week
• 66RING / tiny-flash-attention
  flash attention tutorial written in python, triton, cuda, cutlass
  ☆194Updated 4 months ago
• Liu-xiandong / How_to_optimize_in_GPU
  This is a series of GPU optimization topics. Here we will introduce how to optimize the CUDA kernel in detail. I will introduce several…
  ☆824Updated last year
• microsoft / BitBLAS
  BitBLAS is a library to support mixed-precision matrix multiplications, especially for quantized LLM deployment.
  ☆407Updated this week
• wangsiping97 / FastGEMV
  High-speed GEMV kernels, at most 2.7x speedup compared to pytorch baseline.
  ☆87Updated 3 months ago
• tpoisonooo / how-to-optimize-gemm
  row-major matmul optimization
  ☆590Updated last year
• FlagOpen / FlagGems
  FlagGems is an operator library for large language models implemented in Triton Language.
  ☆328Updated this week
• olcf / cuda-training-series
  Training materials associated with NVIDIA's CUDA Training Series (www.olcf.ornl.gov/cuda-training-series/)
  ☆604Updated 2 months ago
• albanD / subclass_zoo
  ☆147Updated 4 months ago
• openxla / stablehlo
  Backward compatible ML compute opset inspired by HLO/MHLO
  ☆408Updated this week
• NVIDIA / nsight-training
  Training material for Nsight developer tools
  ☆128Updated 3 months ago