📚200+ Tensor/CUDA Cores Kernels, ⚡️flash-attn-mma, ⚡️hgemm with WMMA, MMA and CuTe (98%~100% TFLOPS of cuBLAS/FA2 🎉🎉).
☆91Apr 26, 2025Updated last year
Alternatives and similar repositories for CUDA-Learn-Notes
Users that are interested in CUDA-Learn-Notes are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Modern CUDA Learn Notes with PyTorch for Beginners, 200+ CUDA Kernels, Tensor Cores, HGEMM, FA-2 MMA.☆11,777Updated this week
- ☆20Aug 26, 2021Updated 4 years ago
- 📖A curated list of Awesome LLM/VLM Inference Papers with codes: WINT8/4, FlashAttention, PagedAttention, MLA, Parallelism, etc. 🎉🎉☆21Mar 30, 2025Updated last year
- FHE (CKKS, TFHE) end-to-end applications: HELR (logistic regression), ResNet-20, LSTM (RNN), bitonic sorting, DeepCNN-x☆18Aug 14, 2024Updated 2 years ago
- Visualize the Expert Parallelism Load Balancer☆19Mar 15, 2025Updated last year
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- CUDA 算子手撕与面试指南☆1,082Aug 23, 2025Updated 11 months ago
- ☆73Jan 6, 2025Updated last year
- Fast and Memory-Efficient Exact Attention for Large Headdim, 1.5x~6x speedup over PyTorch SDPA.☆322Updated this week
- ☆23Aug 20, 2025Updated 11 months ago
- TinyML and Efficient Deep Learning Computing☆20Apr 26, 2024Updated 2 years ago
- ECE408 (Applied Parallel Programming) Fall 2022 MP☆22Mar 24, 2023Updated 3 years ago
- A practical way of learning Swizzle☆45Feb 3, 2025Updated last year
- NVFP4 Flash-Attention 4 on BlackWell☆42Jul 23, 2026Updated 3 weeks ago
- fake CUTLASS to get peformance☆26Apr 28, 2026Updated 3 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ☆122May 16, 2025Updated last year
- LLM Inference FrameWork☆33May 20, 2026Updated 2 months ago
- 先进编译实验室的个人主页☆251Oct 15, 2025Updated 10 months ago
- 高性能短序列稀疏Mask Attention CUDA算子，针对<1K序列+75%稀疏度优化☆80Mar 18, 2026Updated 5 months ago
- ☆189May 11, 2026Updated 3 months ago
- A TensorFlow Extension: GPU performance tools for TensorFlow.☆26Jul 27, 2023Updated 3 years ago
- ☆30Apr 7, 2025Updated last year
- ☆66Feb 15, 2026Updated 6 months ago
- how to optimize some algorithm in cuda.☆3,204Updated this week
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- A self-learning tutorail for CUDA High Performance Programing.☆1,076Jan 14, 2026Updated 7 months ago
- Agentic Kernel Optimization for All — automated GPU kernel optimization for any kernel, any hardware, any language☆351Updated this week
- Lab 5 project of MIT-6.5940, deploying LLaMA2-7B-chat on one's laptop with TinyChatEngine.☆18Dec 1, 2023Updated 2 years ago
- High Performance LLM Inference Operator Library☆1,119Aug 6, 2026Updated last week
- let coding agents use ncu skills analysis cuda program automatically!☆120May 25, 2026Updated 2 months ago
- From Minimal GEMM to Everything☆234Jul 9, 2026Updated last month
- ⚡️Qwen-Image 4.8x🎉 speedup with Hybrid Acceleration for low VRAM GPUs☆17Oct 24, 2025Updated 9 months ago
- FlashInfer: Kernel Library for LLM Serving☆6,187Updated this week
- writing really fast kernels☆19Jul 15, 2026Updated last month
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ☆10Apr 24, 2023Updated 3 years ago
- Scikit-learn style machine learning library for JavaScript & TypeScript — classification, regression, clustering, and anomaly detection i…☆16Aug 3, 2026Updated 2 weeks ago
- [ICML 2022] "Linearity Grafting: Relaxed Neuron Pruning Helps Certifiable Robustness" by Tianlong Chen*, Huan Zhang*, Zhenyu Zhang, Shiyu…☆16Jun 22, 2022Updated 4 years ago
- My study note for mlsys☆15Nov 4, 2024Updated last year
- A lightweight design for computation-communication overlap.☆243Jan 20, 2026Updated 6 months ago
- ☆49Apr 15, 2024Updated 2 years ago
- GEMM by WMMA (tensor core)☆15Jul 31, 2022Updated 4 years ago