A curated resource list for learning AI performance engineering, from GPU fundamentals to production inference.
☆4,099Sep 12, 2026Updated 3 weeks ago
Alternatives and similar repositories for gpu-perf-engineering-resources
Users that are interested in gpu-perf-engineering-resources are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Code, labs, and resources for O'Reilly AI Systems Performance Engineering: GPU optimization, distributed training, inference scaling, and…☆2,048Sep 27, 2026Updated last week
- GPU programming related news and material links☆2,371Jun 15, 2026Updated 3 months ago
- A Python DSL to write Nvidia PTX for Hopper and Blackwell in JAX and PyTorch☆384Jul 9, 2026Updated 3 months ago
- GPU Engineering for AI Systems☆602May 17, 2026Updated 4 months ago
- Learn CUDA with PyTorch☆494Updated this week
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- Course on Flash-attention in Triton☆104Feb 9, 2026Updated 8 months ago
- a whirlwind tour to deep learning and deep learning systems☆95Updated this week
- Reverse engineering NVIDIA SASS instruction dictionary, kernel audits and pattern recognition across GPU architectures.☆342May 18, 2026Updated 4 months ago
- A curated list of resources for learning and exploring Triton, OpenAI's programming language for writing efficient GPU code.☆500Mar 10, 2025Updated last year
- FlashInfer: Kernel Library for LLM Serving☆6,578Updated this week
- Tile primitives for speedy kernels☆3,746Sep 12, 2026Updated 3 weeks ago
- 100 days of building GPU kernels!☆630Apr 27, 2025Updated last year
- A compact implementation of SGLang, designed to demystify the complexities of modern LLM serving systems.☆5,237May 17, 2026Updated 4 months ago
- Puzzles for learning Triton☆2,625Apr 1, 2026Updated 6 months ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Competitive GPU kernel optimization platform.☆230Jul 21, 2026Updated 2 months ago
- Curated collection of AI inference engineering resources — LLM serving, GPU kernels, quantization, distributed inference, and production …☆338Feb 4, 2026Updated 8 months ago
- ☆4,134Mar 11, 2026Updated 6 months ago
- Complete solutions to the Programming Massively Parallel Processors Edition 4☆893Sep 7, 2026Updated last month
- Companion code for Grokking Megakernels: fuse an entire LLM forward pass into a single CUDA kernel☆30Feb 9, 2026Updated 8 months ago
- An MLIR-based compiler that takes GPU kernels and compiles them to real hardware instructions. Interactive web visualizer included.☆147Mar 21, 2026Updated 6 months ago
- A curated collection of resources, tutorials, and best practices for learning and mastering NVIDIA CUTLASS☆275May 6, 2025Updated last year
- NVIDIA curated collection of educational resources related to general purpose GPU programming.☆2,040Updated this week
- Machine Learning Systems: Foundations, Scaling, Agentic AI, and Physical AI (Vols I–IV) • Harvard CS249r | https://mlsysbook.ai☆28,923Updated this week
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Material for gpu-mode lectures☆6,824Sep 9, 2026Updated last month
- Helpful kernel tutorials, examples and SKILLs for tile-based GPU programming☆823Updated this week
- The Art of Debugging Open Book☆1,735Updated this week
- A Datacenter Scale Distributed Inference Serving Framework☆8,251Updated this week
- Fast low-bit matmul kernels in Triton☆488Oct 1, 2026Updated last week
- CUDA Templates and Python DSLs for High-Performance Linear Algebra☆10,547Sep 23, 2026Updated 2 weeks ago
- LMCache: Supercharge Your LLM with the Fastest KV Cache Layer☆11,985Updated this week
- Home for "How To Scale Your Model", a short blog-style textbook about scaling LLMs on TPUs☆1,469Sep 22, 2026Updated 2 weeks ago
- Build your own high performance LLM inference engine in C++ and CUDA - a smaller version of vLLM☆1,148Sep 24, 2026Updated 2 weeks ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Official Problem Sets / Reference Kernels for the GPU MODE Leaderboard!☆315Sep 18, 2026Updated 3 weeks ago
- An ML Systems Onboarding list☆1,138Feb 19, 2026Updated 7 months ago
- Fastest kernels written from scratch☆627Aug 15, 2026Updated last month
- Interactive version of the CuTe layout paper☆57Apr 14, 2026Updated 5 months ago
- a personal collection of my notes for ml sys☆124Sep 1, 2026Updated last month
- Anthropic's original performance take-home, now open for you to try!☆4,179Jan 22, 2026Updated 8 months ago
- A pure-Python implementation of the Nvidia CuTe layout algebra intended to be approachable and easy to learn.☆253Jun 29, 2026Updated 3 months ago