Official Problem Sets / Reference Kernels for the GPU MODE Leaderboard!
☆277Jun 26, 2026Updated this week
Alternatives and similar repositories for reference-kernels
Users that are interested in reference-kernels are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆160Updated this week
- Row-wise block scaling for fp8 quantization matrix multiplication. Solution to GPU mode AMD challenge.☆19Feb 9, 2026Updated 4 months ago
- ☆19Jun 6, 2025Updated last year
- Write a fast kernel and see how you compare against the best humans and AI on gpumode.com☆100Updated this week
- Step by step implementation of a fast softmax kernel in CUDA☆68Jan 6, 2025Updated last year
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- Cataloging released Triton kernels.☆308Sep 9, 2025Updated 9 months ago
- This repository contains companion software for the Colfax Research paper "Categorical Foundations for CuTe Layouts".☆137Sep 24, 2025Updated 9 months ago
- Super fast FP32 matrix multiplication on RDNA3☆92Mar 30, 2025Updated last year
- ☆18Dec 2, 2024Updated last year
- Tensara's GPU programming problems☆20Apr 23, 2026Updated 2 months ago
- Quantized LLM training in pure CUDA/C++.☆248Jun 3, 2026Updated 3 weeks ago
- GPU programming related news and material links☆2,206Jun 15, 2026Updated 2 weeks ago
- KernelBench: Can LLMs Write GPU Kernels? - Benchmark + Toolkit with Torch -> CUDA (+ more DSLs)☆1,080Mar 24, 2026Updated 3 months ago
- Wave: Python Domain-Specific Language for High Performance Machine Learning☆58Jun 8, 2026Updated 3 weeks ago
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- High Performance FP8 GEMM Kernels for SM89 and later GPUs.☆21Jan 24, 2025Updated last year
- Personal solutions to the Triton Puzzles☆21Jul 18, 2024Updated last year
- Attention in SRAM on Tenstorrent Grayskull☆38Jul 18, 2024Updated last year
- ☆24May 26, 2026Updated last month
- ☆13Dec 22, 2024Updated last year
- A pure-Python implementation of the Nvidia CuTe layout algebra intended to be approachable and easy to learn.☆188May 15, 2026Updated last month
- KsanaDiT: High-Performance DiT (Diffusion Transformer) Inference Framework for Video & Image Generation☆60May 13, 2026Updated last month
- A curated list of resources for learning and exploring Triton, OpenAI's programming language for writing efficient GPU code.☆491Mar 10, 2025Updated last year
- A Quirky Assortment of CuTe Kernels☆1,035Updated this week
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Generating Efficient AI-Centric Kernels☆105Updated this week
- run tinygrad kernels on esp32☆14Nov 28, 2023Updated 2 years ago
- FlashInfer Bench @ MLSys 2026: Building AI agents to write high performance GPU kernels☆172Apr 26, 2026Updated 2 months ago
- Fast CUDA matrix multiplication from scratch☆1,222Sep 2, 2025Updated 9 months ago
- Tutorial Exercises and Code for GPU Communications Tutorial at HOT Interconnects 2025☆32Oct 22, 2025Updated 8 months ago
- Ship correct and fast LLM kernels to PyTorch☆151Jan 14, 2026Updated 5 months ago
- Tritonbench is a collection of PyTorch custom operators with example inputs to measure their performance.☆359Updated this week
- AI Tensor Engine for ROCm☆471Updated this week
- Fastest kernels written from scratch☆583Sep 18, 2025Updated 9 months ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- Material for gpu-mode lectures☆6,262Jun 15, 2026Updated 2 weeks ago
- DeeperGEMM: crazy optimized version☆86May 5, 2025Updated last year
- A Python library for building modular, reproducible simulation pipelines in minutes☆34Aug 22, 2025Updated 10 months ago
- AMD-SHARK Inference Modeling and Serving☆67May 28, 2026Updated last month
- [ACL 2026 🔥] CASS: Nvidia to AMD Transpilation with Data, Models, and Benchmark☆34Apr 20, 2026Updated 2 months ago
- A curated collection of resources, tutorials, and best practices for learning and mastering NVIDIA CUTLASS☆261May 6, 2025Updated last year
- ☆13Jul 24, 2024Updated last year