wafer-ai / gpu-perf-engineering-resourcesLinks
A curriculum for learning about gpu performance engineering, from scratch to what the frontier AI labs do
☆169Updated this week
Alternatives and similar repositories for gpu-perf-engineering-resources
Users that are interested in gpu-perf-engineering-resources are comparing it to the libraries listed below
Sorting:
- Learn CUDA with PyTorch☆176Updated 3 weeks ago
- Small scale distributed training of sequential deep learning models, built on Numpy and MPI.☆154Updated 2 years ago
- A curated list of resources for learning and exploring Triton, OpenAI's programming language for writing efficient GPU code.☆453Updated 10 months ago
- A curated collection of resources, tutorials, and best practices for learning and mastering NVIDIA CUTLASS☆247Updated 8 months ago
- Slides, notes, and materials for the workshop☆338Updated last year
- Official Problem Sets / Reference Kernels for the GPU MODE Leaderboard!☆188Updated 3 weeks ago
- ☆128Updated 2 months ago
- Write a fast kernel and run it on Discord. See how you compare against the best!☆66Updated last week
- ☆907Updated last week
- Simple MPI implementation for prototyping or learning☆299Updated 5 months ago
- Some CUDA example code with READMEs.☆179Updated 2 months ago
- A repository to unravel the language of GPUs, making their kernel conversations easy to understand☆195Updated 7 months ago
- Learning about CUDA by writing PTX code.☆151Updated last year
- 100 days of building GPU kernels!☆561Updated 8 months ago
- Home for "How To Scale Your Model", a short blog-style textbook about scaling LLMs on TPUs☆807Updated this week
- GPU documentation for humans☆501Updated this week
- ☆78Updated 2 years ago
- Cataloging released Triton kernels.☆282Updated 4 months ago
- Helpful kernel tutorials and examples for tile-based GPU programming☆568Updated this week
- High-Performance SGEMM on CUDA devices☆115Updated 11 months ago
- An implementation of the transformer architecture onto an Nvidia CUDA kernel☆202Updated 2 years ago
- ☆271Updated this week
- Collection of kernels written in Triton language☆174Updated 9 months ago
- NVIDIA tools guide☆152Updated last year
- Fastest kernels written from scratch☆523Updated 3 months ago
- PTX-Tutorial Written Purely By AIs (Deep Research of Openai and Claude 3.7)☆66Updated 9 months ago
- Quantized LLM training in pure CUDA/C++.☆231Updated this week
- ☆409Updated 9 months ago
- Fast low-bit matmul kernels in Triton☆423Updated 3 weeks ago
- Evaluating Large Language Models for CUDA Code Generation ComputeEval is a framework designed to generate and evaluate CUDA code from Lar …☆91Updated last week