tpn / cuda-by-exampleLinks
Code for NVIDIA's CUDA By Example Book.
☆48Updated 5 years ago
Alternatives and similar repositories for cuda-by-example
Users that are interested in cuda-by-example are comparing it to the libraries listed below
Sorting:
- Some CUDA design patterns and a bit of template magic for CUDA☆158Updated 2 years ago
- ⚡️Write HGEMM from scratch using Tensor Cores with WMMA, MMA and CuTe API, Achieve Peak⚡️ Performance.☆148Updated 8 months ago
- CUDA 6大并行计算模式 代码与笔记☆61Updated 5 years ago
- Standalone Flash Attention v2 kernel without libtorch dependency☆114Updated last year
- LLM training in simple, raw C/CUDA☆112Updated last year
- SGEMM optimization with cuda step by step☆21Updated last year
- CUDA Matrix Multiplication Optimization☆256Updated last year
- Tutorials for writing high-performance GPU operators in AI frameworks.☆136Updated 2 years ago
- ☆17Updated 2 years ago
- A Visual Studio Code extension for building and debugging CUDA applications.☆100Updated last week
- A tiny deep learning training framework implemented from scratch in C++ that follows PyTorch's API.☆150Updated last week
- 🤖FFPA: Extend FlashAttention-2 with Split-D, ~O(1) SRAM complexity for large headdim, 1.8x~3x↑🎉 vs SDPA EA.☆250Updated this week
- ☆34Updated last year
- ☆14Updated 3 months ago
- A set of hands-on tutorials for CUDA programming☆247Updated last year
- A Minimalistic Auto-Diff Optimization Framework for Teaching and Understanding Pytorch☆26Updated 2 weeks ago
- Step-by-step optimization of CUDA SGEMM☆428Updated 3 years ago
- ☆21Updated 4 years ago
- This is a demo how to write a high performance convolution run on apple silicon☆57Updated 4 years ago
- study of cutlass☆22Updated last year
- Learning and practice of high performance computing (CUDA, Vulkan, OpenCL, OpenMP, TBB, SSE/AVX, NEON, MPI, coroutines, etc. )☆62Updated 10 months ago
- CUDA by Example, written by two senior members of the CUDA software platform team, shows programmers how to employ this new technology. …☆473Updated 2 years ago
- Awesome code, projects, books, etc. related to CUDA☆30Updated this week
- Benchmark code for the "Online normalizer calculation for softmax" paper☆105Updated 7 years ago
- C++ implementations for various tokenizers (sentencepiece, tiktoken etc).☆48Updated this week
- Common libraries for PPL projects☆31Updated 10 months ago
- Examples from Programming in Parallel with CUDA☆170Updated last week
- CUDA 8-bit Tensor Core Matrix Multiplication based on m16n16k16 WMMA API☆35Updated 2 years ago
- THIS REPOSITORY HAS MOVED TO github.com/nvidia/cub, WHICH IS AUTOMATICALLY MIRRORED HERE.☆85Updated last year
- A faster implementation of OpenCV-CUDA that uses OpenCV objects, and more!☆54Updated 2 months ago