Alternatives and similar repositories for cuda-by-example

Users that are interested in cuda-by-example are comparing it to the libraries listed below

• tlc-pack / libflash_attn
  Standalone Flash Attention v2 kernel without libtorch dependency
  ☆110Updated last year
• leimao / CUDA-GEMM-Optimization
  CUDA Matrix Multiplication Optimization
  ☆222Updated last year
• wangzyon / NVIDIA_SGEMM_PRACTICE
  Step-by-step optimization of CUDA SGEMM
  ☆378Updated 3 years ago
• Syencil / Programming_Massively_Parallel_Processors
  CUDA 6大并行计算模式 代码与笔记
  ☆60Updated 5 years ago
• xlite-dev / HGEMM
  ⚡️Write HGEMM from scratch using Tensor Cores with WMMA, MMA and CuTe API, Achieve Peak⚡️ Performance.
  ☆116Updated 4 months ago
• yester31 / Cutlass_EX
  study of cutlass
  ☆22Updated 10 months ago
• BBuf / tensorrt-llm-moe
  ☆32Updated 7 months ago
• puttsk / cuda-tutorial
  A set of hands-on tutorials for CUDA programming
  ☆239Updated last year
• PatWie / cuda-design-patterns
  Some CUDA design patterns and a bit of template magic for CUDA
  ☆156Updated 2 years ago
• xlite-dev / ffpa-attn
  🤖FFPA: Extend FlashAttention-2 with Split-D, ~O(1) SRAM complexity for large headdim, 1.8x~3x↑🎉 vs SDPA EA.
  ☆218Updated last month
• MegEngine / cutlass
  CUDA Templates for Linear Algebra Subroutines
  ☆100Updated last year
• Libraries-Openly-Fused / cvGPUSpeedup
  A faster implementation of OpenCV-CUDA that uses OpenCV objects, and more!
  ☆53Updated this week
• Bruce-Lee-LY / cuda_hgemv
  Several optimization methods of half-precision general matrix vector multiplication (HGEMV) using CUDA core.
  ☆65Updated last year
• pigirons / conv3x3_m1
  This is a demo how to write a high performance convolution run on apple silicon
  ☆54Updated 3 years ago
• openmlsys / openmlsys-cuda
  Tutorials for writing high-performance GPU operators in AI frameworks.
  ☆131Updated 2 years ago
• JieRen98 / SGEMM-SASS-Annotation
  ☆21Updated 4 years ago
• cjmcv / hpc
  Learning and practice of high performance computing (CUDA, Vulkan, OpenCL, OpenMP, TBB, SSE/AVX, NEON, MPI, coroutines, etc. )
  ☆61Updated 6 months ago
• li199603 / sgemm_with_cuda
  SGEMM optimization with cuda step by step
  ☆20Updated last year
• NVIDIA / nsight-vscode-edition
  A Visual Studio Code extension for building and debugging CUDA applications.
  ☆90Updated 2 weeks ago
• CodedK / CUDA-by-Example-source-code-for-the-book-s-examples-
  CUDA by Example, written by two senior members of the CUDA software platform team, shows programmers how to employ this new technology. …
  ☆441Updated 2 years ago
• NVIDIA / online-softmax
  Benchmark code for the "Online normalizer calculation for softmax" paper
  ☆99Updated 7 years ago
• jundaf2 / CUDA-INT8-GEMM
  CUDA 8-bit Tensor Core Matrix Multiplication based on m16n16k16 WMMA API
  ☆32Updated 2 years ago
• wangsiping97 / FastGEMV
  High-speed GEMV kernels, at most 2.7x speedup compared to pytorch baseline.
  ☆114Updated last year
• OpenPPL / ppl.kernel.cuda
  ☆37Updated 11 months ago
• gpu-mode / reference-kernels
  Official Problem Sets / Reference Kernels for the GPU MODE Leaderboard!
  ☆96Updated last week
• ROCm / aotriton
  Ahead of Time (AOT) Triton Math Library
  ☆76Updated last week
• ankan-ban / llama_cu_awq
  llama INT4 cuda inference with AWQ
  ☆55Updated 8 months ago
• hova88 / CUDA-MatMul-Practice
  ☆17Updated last year
• gevtushenko / llm.c
  LLM training in simple, raw C/CUDA
  ☆104Updated last year
• wzsh / wmma_tensorcore_sample
  Matrix Multiply-Accumulate with CUDA and WMMA( Tensor Core)
  ☆143Updated 5 years ago