Alternatives and similar repositories for performance-engineering

Users that are interested in performance-engineering are comparing it to the libraries listed below

• gevtushenko / llm.c
  LLM training in simple, raw C/CUDA
  ☆112Updated last year
• salykova / sgemm.cu
  High-Performance FP32 GEMM on CUDA devices
  ☆117Updated last year
• gpu-mode / kernelbot
  Write a fast kernel and run it on Discord. See how you compare against the best!
  ☆71Updated this week
• drkennetz / cuda_examples
  Some CUDA example code with READMEs.
  ☆179Updated 2 months ago
• ademeure / QuickRunCUDA
  ☆15Updated 3 months ago
• vedantroy / gpu_kernels
  ☆27Updated 2 years ago
• unixpickle / learn-ptx
  Learning about CUDA by writing PTX code.
  ☆152Updated last year
• gpu-mode / popcorn-cli
  ☆95Updated this week
• TiledTensor / TiledBench
  Benchmark tests supporting the TiledCUDA library.
  ☆18Updated last year
• UmerHA / triton_util
  Make triton easier
  ☆50Updated last year
• groq / mlagility
  Machine Learning Agility (MLAgility) benchmark and benchmarking tools
  ☆40Updated 6 months ago
• SzymonOzog / Penny
  Hand-Rolled GPU communications library
  ☆82Updated 2 months ago
• cloneofsimo / ptx-tutorial-by-aislop
  PTX-Tutorial Written Purely By AIs (Deep Research of Openai and Claude 3.7)
  ☆66Updated 10 months ago
• meta-pytorch / triton-cpu
  An experimental CPU backend for Triton (https//github.com/openai/triton)
  ☆49Updated 5 months ago
• LaurieWired / BenchmarkCustomPTX
  Custom PTX Instruction Benchmark
  ☆138Updated 11 months ago
• meta-pytorch / tlparse
  TORCH_TRACE parser for PT2
  ☆76Updated this week
• wafer-ai / gpu-perf-engineering-resources
  A curriculum for learning about gpu performance engineering, from scratch to what the frontier AI labs do
  ☆341Updated 3 weeks ago
• Jokeren / triton-samples
  ☆28Updated last year
• HamzaElshafie / h100_gemm
  A series of high-performance GEMM (General Matrix Multiply) implementations Iteratively optimised for H100 GPUs in Pure CUDA.
  ☆64Updated 3 weeks ago
• axonn-ai / axonn
  Parallel framework for training and fine-tuning deep neural networks
  ☆70Updated 3 months ago
• NVIDIA / compute-sanitizer-samples
  Samples demonstrating how to use the Compute Sanitizer Tools and Public API
  ☆93Updated 2 years ago
• facebookresearch / FAMBench
  Benchmarks to capture important workloads.
  ☆32Updated 2 weeks ago
• gpu-mode / reference-kernels
  Official Problem Sets / Reference Kernels for the GPU MODE Leaderboard!
  ☆201Updated this week
• tgautam03 / tGeMM
  General Matrix Multiplication using NVIDIA Tensor Cores
  ☆28Updated last year
• meta-pytorch / tritonparse
  TritonParse: A Compiler Tracer, Visualizer, and Reproducer for Triton Kernels
  ☆194Updated this week
• IBM / triton-dejavu
  Framework to reduce autotune overhead to zero for well known deployments.
  ☆96Updated 4 months ago
• lessw2020 / triton_kernels_for_fun_and_profit
  Custom kernels in Triton language for accelerating LLMs
  ☆27Updated last year
• meta-pytorch / BackendBench
  Ship correct and fast LLM kernels to PyTorch
  ☆140Updated 3 weeks ago
• EugenHotaj / llm_parallelisms.c
  LLM training parallelisms (DP, FSDP, TP, PP) in pure C
  ☆26Updated 2 weeks ago
• moritztng / grayskull-attention
  Attention in SRAM on Tenstorrent Grayskull
  ☆40Updated last year