A tutorial on modern GPU programming for machine learning systems
☆1,017Jul 18, 2026Updated this week
Alternatives and similar repositories for modern-gpu-programming-for-mlsys
Users that are interested in modern-gpu-programming-for-mlsys are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ML kernels and benchmarking infrastructure written in TIRx☆66Updated this week
- A kernel library written in tilelang☆1,643Apr 23, 2026Updated 2 months ago
- Domain-specific language designed to streamline the development of high-performance GPU/CPU/Accelerators kernels☆6,674Updated this week
- FlashInfer: Kernel Library for LLM Serving☆5,988Updated this week
- 📚LeetCUDA: Modern CUDA Learn Notes with PyTorch for Beginners🐑, 200+ CUDA Kernels, Tensor Cores, HGEMM, FA-2 MMA.🎉☆11,578Updated this week
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ☆754Jun 2, 2026Updated last month
- Compact and Agent-Native MoE Training System☆290Updated this week
- High Performance LLM Inference Operator Library☆1,041Updated this week
- Distributed Compiler based on Triton for Parallel Systems☆1,494Updated this week
- ☆310Jun 9, 2026Updated last month
- A compact implementation of SGLang, designed to demystify the complexities of modern LLM serving systems.☆4,607May 17, 2026Updated 2 months ago
- Tile-Based Runtime for Ultra-Low-Latency LLM Inference☆1,573Jul 14, 2026Updated last week
- Skills for writing tilelang and debugging with CUDA toolkits.☆131May 20, 2026Updated 2 months ago
- CUDA kernels for linear attention variants, written in CuTe DSL and CUTLASS C++.☆534Updated this week
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- My learning notes for ML SYS.☆6,753Updated this week
- Learning TileLang with 10 puzzles!☆338May 28, 2026Updated last month
- NVSHMEM‑Tutorial: Build a DeepEP‑like GPU Buffer☆195Feb 11, 2026Updated 5 months ago
- mKernel: fast multi-node, multi-GPU fused kernels☆251Jun 21, 2026Updated last month
- CUDA Templates and Python DSLs for High-Performance Linear Algebra☆10,104Updated this week
- Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.☆5,925Updated this week
- Nano vLLM☆14,557Apr 26, 2026Updated 2 months ago
- Open ABI and FFI for Machine Learning Systems☆434Updated this week
- 分享AI Infra知识&代码练习：PyTorch、vLLM/SGLang、slime/vime框架入门⚡️、性能加速🚀、大模型基础🧠、AI软硬件🔧等☆2,996Jul 2, 2026Updated 2 weeks ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Agentic Kernel Optimization for All — automated GPU kernel optimization for any kernel, any hardware, any language☆323May 31, 2026Updated last month
- ☆156May 24, 2026Updated last month
- FlashKDA: high-performance Kimi Delta Attention kernels☆462May 26, 2026Updated last month
- Material for gpu-mode lectures☆6,330Jun 15, 2026Updated last month
- NVIDIA cuTile learn☆169Dec 9, 2025Updated 7 months ago
- An Optimizer for Nvidia Compilers.☆107Jul 3, 2026Updated 2 weeks ago
- A Quirky Assortment of CuTe Kernels☆1,063Updated this week
- how to optimize some algorithm in cuda.☆3,142Updated this week
- high-performance linear attention kernel library built on TileLang☆597Updated this week
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- cuTile is a programming model for writing parallel kernels for NVIDIA GPUs☆2,121Updated this week
- NVIDIA NVSHMEM is a parallel programming interface for NVIDIA GPUs based on OpenSHMEM. NVSHMEM can significantly reduce multi-process com…☆560Updated this week
- ☆691Jul 14, 2026Updated last week
- Fastest kernels written from scratch☆583Sep 18, 2025Updated 10 months ago
- TokenSpeed is a speed-of-light LLM inference engine.☆1,638Updated this week
- 🚀 Efficient implementations for emerging model architectures☆5,379Updated this week
- ☆149Jun 6, 2026Updated last month