A curated resource list for learning AI performance engineering, from GPU fundamentals to production inference.
☆3,210Sep 12, 2026Updated last week
Alternatives and similar repositories for gpu-perf-engineering-resources
Users that are interested in gpu-perf-engineering-resources are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Code, labs, and resources for O'Reilly AI Systems Performance Engineering: GPU optimization, distributed training, inference scaling, and…☆1,963Updated this week
- GPU programming related news and material links☆2,332Jun 15, 2026Updated 3 months ago
- A Python DSL to write Nvidia PTX for Hopper and Blackwell in JAX and PyTorch☆382Jul 9, 2026Updated 2 months ago
- Learn CUDA with PyTorch☆483Updated this week
- GPU Engineering for AI Systems☆596May 17, 2026Updated 4 months ago
- End-to-end encrypted cloud storage - Proton Drive • AdSpecial offer: 40% Off Yearly / 80% Off First Month. Protect your most important files, photos, and documents from prying eyes.
- Course on Flash-attention in Triton☆104Feb 9, 2026Updated 7 months ago
- a whirlwind tour to deep learning and deep learning systems☆83Updated this week
- Reverse engineering NVIDIA SASS instruction dictionary, kernel audits and pattern recognition across GPU architectures.☆340May 18, 2026Updated 4 months ago
- A curated list of resources for learning and exploring Triton, OpenAI's programming language for writing efficient GPU code.☆498Mar 10, 2025Updated last year
- FlashInfer: Kernel Library for LLM Serving☆6,452Updated this week
- Tile primitives for speedy kernels☆3,716Sep 12, 2026Updated last week
- 100 days of building GPU kernels!☆628Apr 27, 2025Updated last year
- Puzzles for learning Triton☆2,601Apr 1, 2026Updated 5 months ago
- A compact implementation of SGLang, designed to demystify the complexities of modern LLM serving systems.☆5,096May 17, 2026Updated 4 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Competitive GPU kernel optimization platform.☆227Jul 21, 2026Updated last month
- ☆4,064Mar 11, 2026Updated 6 months ago
- Complete solutions to the Programming Massively Parallel Processors Edition 4☆868Sep 7, 2026Updated last week
- Curated collection of AI inference engineering resources — LLM serving, GPU kernels, quantization, distributed inference, and production …☆310Feb 4, 2026Updated 7 months ago
- Companion code for Grokking Megakernels: fuse an entire LLM forward pass into a single CUDA kernel☆30Feb 9, 2026Updated 7 months ago
- An MLIR-based compiler that takes GPU kernels and compiles them to real hardware instructions. Interactive web visualizer included.☆145Mar 21, 2026Updated 5 months ago
- A curated collection of resources, tutorials, and best practices for learning and mastering NVIDIA CUTLASS☆272May 6, 2025Updated last year
- NVIDIA curated collection of educational resources related to general purpose GPU programming.☆1,993Updated this week
- Machine Learning Systems: Foundations, Scaling, Agentic AI, and Physical AI (Vols I–IV) • Harvard CS249r | https://mlsysbook.ai☆28,353Updated this week
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Material for gpu-mode lectures☆6,617Sep 9, 2026Updated last week
- Helpful kernel tutorials, examples and SKILLs for tile-based GPU programming☆810Updated this week
- The Art of Debugging Open Book☆1,722Sep 3, 2026Updated 2 weeks ago
- A Datacenter Scale Distributed Inference Serving Framework☆8,120Updated this week
- Fast low-bit matmul kernels in Triton☆485Aug 9, 2026Updated last month
- CUDA Templates and Python DSLs for High-Performance Linear Algebra☆10,457Updated this week
- Home for "How To Scale Your Model", a short blog-style textbook about scaling LLMs on TPUs☆1,441Sep 3, 2026Updated 2 weeks ago
- Build your own high performance LLM inference engine in C++ and CUDA - a smaller version of vLLM☆1,120Updated this week
- LMCache: Supercharge Your LLM with the Fastest KV Cache Layer☆11,867Updated this week
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Official Problem Sets / Reference Kernels for the GPU MODE Leaderboard!☆308Updated this week
- An ML Systems Onboarding list☆1,129Feb 19, 2026Updated 7 months ago
- Fastest kernels written from scratch☆623Aug 15, 2026Updated last month
- Interactive version of the CuTe layout paper☆57Apr 14, 2026Updated 5 months ago
- a personal collection of my notes for ml sys☆124Sep 1, 2026Updated 2 weeks ago
- A pure-Python implementation of the Nvidia CuTe layout algebra intended to be approachable and easy to learn.☆243Jun 29, 2026Updated 2 months ago
- https://github.com/gpu-mode/reference-kernels☆26Jul 4, 2026Updated 2 months ago