Alternatives and similar repositories for gpu-perf-engineering-resources

Users that are interested in gpu-perf-engineering-resources are comparing it to the libraries listed below

• gau-nernst / learn-cuda
  Learn CUDA with PyTorch
  ☆193Updated this week
• cfregly / ai-performance-engineering
  ☆991Updated this week
• MekkCyber / CutlassAcademy
  A curated collection of resources, tutorials, and best practices for learning and mastering NVIDIA CUTLASS
  ☆249Updated 8 months ago
• siboehm / ShallowSpeed
  Small scale distributed training of sequential deep learning models, built on Numpy and MPI.
  ☆155Updated 2 years ago
• gpu-mode / reference-kernels
  Official Problem Sets / Reference Kernels for the GPU MODE Leaderboard!
  ☆200Updated this week
• rkinas / triton-resources
  A curated list of resources for learning and exploring Triton, OpenAI's programming language for writing efficient GPU code.
  ☆457Updated 10 months ago
• MekkCyber / TritonAcademy
  A repository to unravel the language of GPUs, making their kernel conversations easy to understand
  ☆197Updated 8 months ago
• Deep-Learning-Profiling-Tools / triton-viz
  ☆286Updated this week
• bertmaher / simplegemm
  ☆129Updated 3 months ago
• gpu-mode / kernelbot
  Write a fast kernel and run it on Discord. See how you compare against the best!
  ☆68Updated this week
• NVIDIA / TileGym
  Helpful kernel tutorials and examples for tile-based GPU programming
  ☆617Updated last week
• mlops-discord / gpu-optimization-workshop
  Slides, notes, and materials for the workshop
  ☆339Updated last year
• gpu-mode / triton-index
  Cataloging released Triton kernels.
  ☆291Updated 4 months ago
• IST-DASLab / llmq
  Quantized LLM training in pure CUDA/C++.
  ☆235Updated 2 weeks ago
• meta-pytorch / torchcomms
  torchcomms: a modern PyTorch communications API
  ☆327Updated this week
• meta-pytorch / tritonparse
  TritonParse: A Compiler Tracer, Visualizer, and Reproducer for Triton Kernels
  ☆189Updated last week
• vllm-project / tpu-inference
  TPU inference for vLLM, with unified JAX and PyTorch support.
  ☆228Updated this week
• zinccat / Awesome-Triton-Kernels
  Collection of kernels written in Triton language
  ☆178Updated last week
• Quentin-Anthony / nanoMPI
  Simple MPI implementation for prototyping or learning
  ☆300Updated 6 months ago
• modal-labs / gpu-glossary
  GPU documentation for humans
  ☆514Updated last week
• drkennetz / cuda_examples
  Some CUDA example code with READMEs.
  ☆179Updated 2 months ago
• jax-ml / scaling-book
  Home for "How To Scale Your Model", a short blog-style textbook about scaling LLMs on TPUs
  ☆827Updated last week
• HazyResearch / Megakernels
  kernels, of the mega variety
  ☆665Updated last week
• stanford-cs149 / cs149gpt
  ☆79Updated 2 years ago
• meta-pytorch / torchft
  Fault tolerance for PyTorch (HSDP, LocalSGD, DiLoCo, Streaming DiLoCo)
  ☆474Updated 3 weeks ago
• dropbox / gemlite
  Fast low-bit matmul kernels in Triton
  ☆427Updated this week
• pytorch / helion
  A Python-embedded DSL that makes it easy to write fast, scalable ML kernels with minimal boilerplate.
  ☆739Updated this week
• ScalingIntelligence / KernelBench
  KernelBench: Can LLMs Write GPU Kernels? - Benchmark + Toolkit with Torch -> CUDA (+ more DSLs)
  ☆781Updated 2 weeks ago
• NVIDIA / tilus
  Tilus is a tile-level kernel programming language with explicit control over shared memory and registers.
  ☆440Updated last month
• meta-pytorch / BackendBench
  Ship correct and fast LLM kernels to PyTorch
  ☆140Updated 3 weeks ago