📚200+ Tensor/CUDA Cores Kernels, ⚡️flash-attn-mma, ⚡️hgemm with WMMA, MMA and CuTe (98%~100% TFLOPS of cuBLAS/FA2 🎉🎉).
☆99Apr 26, 2025Updated last year
Alternatives and similar repositories for CUDA-Learn-Notes
Users that are interested in CUDA-Learn-Notes are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- An Open-source book with Modern CUDA learning Notes for Beginners - BF16/FP8/FP4, HGEMM, CuTe, Flash-Attention, etc.☆12,156Updated this week
- Execution-state orchestration layer for FlashRT: model-runtime adoption, stage-DAG scheduling, RTC action chunks, and capsule state contr…☆13Sep 7, 2026Updated 2 months ago
- Agentic Kernel Optimization — advanced & eXtensible: a closed-loop, campaign-based multi-agent system for optimizing GPU kernels (benchma…☆86Sep 15, 2026Updated last month
- ☆20Aug 26, 2021Updated 5 years ago
- GC MoE is a CuTe DSL implementation of FP8/FP4 mixture-of-experts inference with CUDA Green Contexts for NVIDIA Hopper and Blackwell GPUs…☆18Updated this week
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- ☆74Jan 6, 2025Updated last year
- AI System Performance Lab 是一个工业级的高性能计算与大模型推理优化代码库。它是《AI 系统性能工程》五大专栏的官方配套项目，涵盖了从底层 CUDA 优化到上层大模型系统实现的完整技术栈。☆10Aug 25, 2026Updated 2 months ago
- CUDA 算子手撕与面试指南☆1,144Aug 23, 2025Updated last year
- Visualize the Expert Parallelism Load Balancer☆18Mar 15, 2025Updated last year
- FHE (CKKS, TFHE) end-to-end applications: HELR (logistic regression), ResNet-20, LSTM (RNN), bitonic sorting, DeepCNN-x☆18Aug 14, 2024Updated 2 years ago
- Kernel Library for Large Headdim Attention (64~1024, BF16/FP8/FP4), 1.5x~15x↑ vs PyTorch SDPA.☆346Updated this week
- how to optimize some algorithm in cuda.☆3,341Updated this week
- 📖A curated list of Awesome LLM/VLM Inference Papers with codes: WINT8/4, FlashAttention, PagedAttention, MLA, Parallelism, etc. 🎉🎉☆21Mar 30, 2025Updated last year
- ☆23Aug 20, 2025Updated last year
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- From Minimal GEMM to Everything☆249Jul 9, 2026Updated 3 months ago
- NVFP4 Flash-Attention 4 on BlackWell☆69Sep 26, 2026Updated last month
- ☆27Jun 10, 2026Updated 4 months ago
- TinyML and Efficient Deep Learning Computing☆20Apr 26, 2024Updated 2 years ago
- A practical way of learning Swizzle☆45Feb 3, 2025Updated last year
- Agent-assisted and full-agent reproducibility package for MLSys 2026 FlashInfer AI Kernel Generation Contest submissions: kernels, agent …☆24Jul 21, 2026Updated 3 months ago
- Several optimization methods of half-precision general matrix multiplication (HGEMM) using tensor core with WMMA API and MMA PTX instruct…☆575Sep 8, 2024Updated 2 years ago
- Agentic Kernel Optimization for All — automated GPU kernel optimization for any kernel, any hardware, any language☆380Sep 15, 2026Updated last month
- A self-learning tutorail for CUDA High Performance Programing.☆1,158Jan 14, 2026Updated 9 months ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- 应该是目前第一个比较完善的支持 管家婆 ERP、章鱼侠 ERP 的第三方扩展包了☆13Sep 22, 2021Updated 5 years ago
- fake CUTLASS to get peformance☆26Apr 28, 2026Updated 6 months ago
- 高性能短序列稀疏Mask Attention CUDA算子，针对<1K序列+75%稀疏度优化☆79Mar 18, 2026Updated 7 months ago
- ☆123May 16, 2025Updated last year
- ☆12Mar 3, 2023Updated 3 years ago
- High Performance LLM Inference Operator Library☆1,189Sep 7, 2026Updated 2 months ago
- This is a series of GPU optimization topics. Here we will introduce how to optimize the CUDA kernel in detail. I will introduce several…☆1,367Jul 29, 2023Updated 3 years ago
- A TensorFlow Extension: GPU performance tools for TensorFlow.☆26Jul 27, 2023Updated 3 years ago
- A case study of quantitative modeling for beginners.☆26Jan 26, 2026Updated 9 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- CUTLASS and CuTe Examples☆143Nov 30, 2025Updated 11 months ago
- I seek to draw from the philosophies embedded in AI research to inspire deeper reflection on life — exploring how the principles that gui…☆13Aug 11, 2025Updated last year
- ☆29Apr 7, 2025Updated last year
- ☆194May 11, 2026Updated 5 months ago
- 先进编译实验室的个人主页☆271Oct 15, 2025Updated last year
- ECE408 (Applied Parallel Programming) Fall 2022 MP☆22Mar 24, 2023Updated 3 years ago
- FlashInfer: Kernel Library for LLM Serving☆6,866Updated this week