Official Problem Sets / Reference Kernels for the GPU MODE Leaderboard!
☆250Mar 23, 2026Updated 2 weeks ago
Alternatives and similar repositories for reference-kernels
Users that are interested in reference-kernels are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆140Mar 14, 2026Updated 3 weeks ago
- Row-wise block scaling for fp8 quantization matrix multiplication. Solution to GPU mode AMD challenge.☆19Feb 9, 2026Updated 2 months ago
- ☆18Jun 6, 2025Updated 10 months ago
- Persistent dense gemm for Hopper in `CuTeDSL`☆15Aug 9, 2025Updated 8 months ago
- Write a fast kernel and see how you compare against the best humans and AI on gpumode.com☆90Apr 2, 2026Updated last week
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- This repository contains companion software for the Colfax Research paper "Categorical Foundations for CuTe Layouts".☆121Sep 24, 2025Updated 6 months ago
- Step by step implementation of a fast softmax kernel in CUDA☆65Jan 6, 2025Updated last year
- Cataloging released Triton kernels.☆301Sep 9, 2025Updated 7 months ago
- ☆18Dec 2, 2024Updated last year
- Quantized LLM training in pure CUDA/C++.☆243Mar 6, 2026Updated last month
- GPU programming related news and material links☆2,084Mar 8, 2026Updated last month
- KernelBench: Can LLMs Write GPU Kernels? - Benchmark + Toolkit with Torch -> CUDA (+ more DSLs)☆916Mar 24, 2026Updated 2 weeks ago
- Personal solutions to the Triton Puzzles☆20Jul 18, 2024Updated last year
- High Performance FP8 GEMM Kernels for SM89 and later GPUs.☆21Jan 24, 2025Updated last year
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click and start building anything your business needs.
- A pure-Python implementation of the Nvidia CuTe layout algebra intended to be approachable and easy to learn.☆135Mar 31, 2026Updated last week
- Attention in SRAM on Tenstorrent Grayskull☆38Jul 18, 2024Updated last year
- ☆23Apr 2, 2026Updated last week
- ☆12Dec 22, 2024Updated last year
- A curated list of resources for learning and exploring Triton, OpenAI's programming language for writing efficient GPU code.☆470Mar 10, 2025Updated last year
- Super fast FP32 matrix multiplication on RDNA3☆87Mar 30, 2025Updated last year
- Generating Efficient AI-Centric Kernels☆82Updated this week
- A Quirky Assortment of CuTe Kernels☆898Updated this week
- run tinygrad kernels on esp32☆13Nov 28, 2023Updated 2 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click and start building anything your business needs.
- FlashInfer Bench @ MLSys 2026: Building AI agents to write high performance GPU kernels☆156Updated this week
- Fast CUDA matrix multiplication from scratch☆1,119Sep 2, 2025Updated 7 months ago
- Tutorial Exercises and Code for GPU Communications Tutorial at HOT Interconnects 2025☆31Oct 22, 2025Updated 5 months ago
- Ship correct and fast LLM kernels to PyTorch☆147Jan 14, 2026Updated 2 months ago
- AMD-SHARK Inference Modeling and Serving☆61Apr 1, 2026Updated last week
- AI Tensor Engine for ROCm☆399Apr 3, 2026Updated last week
- Fastest kernels written from scratch☆565Sep 18, 2025Updated 6 months ago
- Material for gpu-mode lectures☆5,923Feb 1, 2026Updated 2 months ago
- DeeperGEMM: crazy optimized version☆86May 5, 2025Updated 11 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting with the flexibility to host WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Cloudways by DigitalOcean.
- Talks I gave over the years as PDF.☆22Apr 2, 2026Updated last week
- CASS: Nvidia to AMD Transpilation with Data, Models, and Benchmark☆34Jun 24, 2025Updated 9 months ago
- A curated collection of resources, tutorials, and best practices for learning and mastering NVIDIA CUTLASS☆254May 6, 2025Updated 11 months ago
- Fast and Furious AMD Kernels☆388Mar 27, 2026Updated last week
- MSLK (Meta Superintelligence Labs Kernels) is a collection of PyTorch GPU operator libraries that are designed and optimized for GenAI tr…☆94Updated this week
- ☆12Jul 24, 2024Updated last year
- Step-by-step optimization of CUDA SGEMM☆453Mar 30, 2022Updated 4 years ago