DefTruth / CUDA-Learn-Notes
📚200+ Tensor/CUDA Cores Kernels, ⚡️flash-attn-mma, ⚡️hgemm with WMMA, MMA and CuTe (98%~100% TFLOPS of cuBLAS/FA2 🎉🎉).
☆2,365Updated this week
Alternatives and similar repositories for CUDA-Learn-Notes:
Users that are interested in CUDA-Learn-Notes are comparing it to the libraries listed below
- how to optimize some algorithm in cuda.☆1,906Updated this week
- This is a series of GPU optimization topics. Here we will introduce how to optimize the CUDA kernel in detail. I will introduce several…☆919Updated last year
- compiler learning resources collect.☆2,280Updated 8 months ago
- A self-learning tutorail for CUDA High Performance Programing.☆369Updated 2 months ago
- 📖A curated list of Awesome LLM/VLM Inference Papers with codes: WINT8/4, Flash-Attention, Paged-Attention, Parallelism, etc. 🎉🎉☆3,456Updated this week
- FlashInfer: Kernel Library for LLM Serving☆2,078Updated this week
- My learning notes/codes for ML SYS.☆822Updated this week
- Material for gpu-mode lectures☆3,731Updated last week
- how to learn PyTorch and OneFlow☆393Updated 10 months ago
- ☆2,317Updated last year
- This is a Chinese translation of the CUDA programming guide☆1,419Updated 3 months ago
- Several simple examples for popular neural network toolkits calling custom CUDA operators.☆1,399Updated 3 years ago
- A CUDA tutorial to make people learn CUDA program from 0☆206Updated 7 months ago
- 校招、秋招、春招、实习好项目,带你从零动手实现支持LLama2/3和Qwen2.5的大模型推理框架。☆289Updated last month
- Large Language Model (LLM) Systems Paper List☆778Updated this week
- Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.☆2,591Updated this week
- ☆598Updated 8 months ago
- Simple samples for TensorRT programming☆1,574Updated 2 months ago
- learning how CUDA works☆200Updated 6 months ago
- A library for accelerating Transformer models on NVIDIA GPUs, including using 8-bit floating point (FP8) precision on Hopper and Ada GPUs…☆2,190Updated this week
- 高性能计算相关知识学习笔记,包含学习笔记和相关知识的代码demo,在持续完善中。 如果有帮助的话请Star一下,对作者帮助很大,谢谢!☆395Updated last year
- GPU programming related news and material links☆1,368Updated last month
- Sample codes for my CUDA programming book☆1,639Updated this week
- CUDA 算子手撕与面试指南☆153Updated last month
- Xiao's CUDA Optimization Guide [Active Adding New Contents]☆264Updated 2 years ago
- 校招、秋招、春招、实习好项目!带你从零实现一个高性能的深度学习推理库,支持大模型 llama2 、Unet、Yolov5、Resnet等模型的推理。Implement a high-performance deep learning inference library st…☆2,715Updated 3 months ago
- PPL Quantization Tool (PPQ) is a powerful offline neural network quantization tool.☆1,620Updated 10 months ago
- ☆1,012Updated 11 months ago
- FlagGems is an operator library for large language models implemented in Triton Language.☆420Updated this week
- A PyTorch Native LLM Training Framework☆732Updated last month