B200 Attention from Scratch: understand one of the hardest GPU kernels on the latest hardware
☆101Oct 9, 2026Updated 3 weeks ago
Alternatives and similar repositories for gpu-kernel-engineering
Users that are interested in gpu-kernel-engineering are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆98Feb 5, 2026Updated 9 months ago
- ☆58Apr 22, 2026Updated 6 months ago
- ☆14Dec 22, 2024Updated last year
- TensorIR is a lightweight NVIDIA-owned MLIR compiler frontend for expressing tensor computations and lowering them to NVIDIA CUDA Tile IR…☆141Oct 28, 2026Updated last week
- FlashTile is a CUDA Tile IR compiler that is compatible with NVIDIA's tileiras, targeting SM70 through SM121 NVIDIA GPUs.☆62Feb 6, 2026Updated 9 months ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- ☆37Aug 7, 2025Updated last year
- ☆156Aug 18, 2025Updated last year
- ☆271Jul 11, 2024Updated 2 years ago
- Exploring how optimizations for GEMMs work☆36Feb 28, 2026Updated 8 months ago
- Some funny cute/cuteDSL code snippets☆35Mar 2, 2026Updated 8 months ago
- Autonomous GPU kernel optimization system driven by AI agents.☆32Mar 29, 2026Updated 7 months ago
- ☆67Feb 15, 2026Updated 8 months ago
- Curated high-performance TIRx GPU kernels☆36Updated this week
- Lifting Array Programs to NumPy, PyTorch, JAX☆12Mar 26, 2025Updated last year
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- A Zero-dependency GEMM library for RTX 50 series (SM120). 100% cuBLAS performance.☆19Aug 31, 2026Updated 2 months ago
- ☆63Sep 27, 2026Updated last month
- ☆23May 5, 2025Updated last year
- Unified tracing profiler and visualizer, one timeline from CPU to GPU/HES to in-kernel zones☆152Sep 21, 2026Updated last month
- Explore training for quantized models☆29Jul 12, 2025Updated last year
- a repo to study TensorRT Plugin☆11Apr 30, 2025Updated last year
- Helpful kernel tutorials, examples and SKILLs for tile-based GPU programming☆834Updated this week
- PTX ISA 9.1 documentation converted to searchable markdown. Includes Claude Code skill for CUDA development.☆231Dec 24, 2025Updated 10 months ago
- mHC kernels implemented in CUDA☆267Mar 9, 2026Updated 7 months ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- ☆17Oct 1, 2026Updated last month
- Implement Flash Attention using Cute.☆113Dec 17, 2024Updated last year
- ☆21Mar 22, 2021Updated 5 years ago
- Performance of the C++ interface of flash attention and flash attention v2 in large language model (LLM) inference scenarios.☆15Aug 31, 2023Updated 3 years ago
- Learn CUDA with PyTorch☆529Oct 3, 2026Updated last month
- Official repository Flash Local Linear Attention☆40May 28, 2026Updated 5 months ago
- This repository provides tutorial, which discusses running sample publisher and subscriber using multiple transports of point_cloud_trans…☆11Aug 26, 2026Updated 2 months ago
- Batched square compact-Householder QR factorization.☆15Jul 2, 2026Updated 4 months ago
- NVIDIA cuTile learn☆168Dec 9, 2025Updated 10 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- 使用 cutlass 仓库在 ada 架构上实现 fp8 的 flash attention☆82Aug 12, 2024Updated 2 years ago
- A lightweight design for computation-communication overlap.☆252Jan 20, 2026Updated 9 months ago
- Automated CUDA kernel performance diagnostics from NVIDIA Nsight Compute (NCU) CSV exports.☆36Mar 18, 2026Updated 7 months ago
- Reference implementation and examples of the CuTe Layout representation and algebra.☆393Updated this week
- NVFP4 Flash-Attention 4 on BlackWell☆69Sep 26, 2026Updated last month
- ☆41Updated this week
- Distributed MoE in a Single Kernel [NeurIPS '25]☆332May 5, 2026Updated 6 months ago