DefTruth / CUDA-Learn-Notes
📚200+ Tensor/CUDA Cores Kernels, ⚡️flash-attn-mma, ⚡️hgemm with WMMA, MMA and CuTe (98%~100% TFLOPS of cuBLAS/FA2 🎉🎉).
☆2,901Updated last week
Alternatives and similar repositories for CUDA-Learn-Notes:
Users that are interested in CUDA-Learn-Notes are comparing it to the libraries listed below
- how to optimize some algorithm in cuda.☆2,022Updated this week
- My learning notes/codes for ML SYS.☆1,481Updated this week
- Material for gpu-mode lectures☆4,075Updated last month
- 📖A curated list of Awesome LLM/VLM Inference Papers with codes: WINT8/4, Flash-Attention, Paged-Attention, Parallelism, etc. 🎉🎉☆3,675Updated 2 weeks ago
- A self-learning tutorail for CUDA High Performance Programing.☆465Updated 2 weeks ago
- This is a series of GPU optimization topics. Here we will introduce how to optimize the CUDA kernel in detail. I will introduce several…☆960Updated last year
- ☆2,366Updated last year
- compiler learning resources collect.☆2,317Updated 9 months ago
- FlashInfer: Kernel Library for LLM Serving☆2,439Updated this week
- This is a Chinese translation of the CUDA programming guide☆1,463Updated 4 months ago
- how to learn PyTorch and OneFlow☆411Updated last year
- A CUDA tutorial to make people learn CUDA program from 0☆221Updated 8 months ago
- CUDA Templates for Linear Algebra Subroutines☆7,150Updated this week
- Sample codes for my CUDA programming book☆1,669Updated last month
- 高性能计算相关知识学习笔记,包含学习笔记和相关知识的代码demo,在持续完善中。 如果有帮助的话请Star一下,对作者帮助很大,谢谢!☆415Updated last year
- Several simple examples for popular neural network toolkits calling custom CUDA operators.☆1,417Updated 3 years ago
- CUDA 算子手撕与面试指南☆225Updated 2 months ago
- Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.☆2,880Updated this week
- learning how CUDA works☆221Updated 2 weeks ago
- Mirage: Automatically Generating Fast GPU Kernels without Programming in Triton/CUDA☆769Updated this week
- LLM notes, including model inference, transformer model structure, and llm framework code analysis notes.☆630Updated this week
- A library for accelerating Transformer models on NVIDIA GPUs, including using 8-bit floating point (FP8) precision on Hopper and Ada GPUs…☆2,293Updated this week
- 校招、秋招、春招、实习好项目,带你从零动手实现支持LLama2/3和Qwen2.5的大模型推理框架。☆309Updated last week
- GPU programming related news and material links☆1,421Updated 2 months ago
- A fast communication-overlapping library for tensor/expert parallelism on GPUs.☆775Updated this week
- FlagGems is an operator library for large language models implemented in Triton Language.☆457Updated this week
- Large Language Model (LLM) Systems Paper List☆823Updated this week
- Fast CUDA matrix multiplication from scratch☆663Updated last year
- PPL Quantization Tool (PPQ) is a powerful offline neural network quantization tool.☆1,654Updated 11 months ago