tpn / cuda-by-exampleLinks
Code for NVIDIA's CUDA By Example Book.
☆45Updated 5 years ago
Alternatives and similar repositories for cuda-by-example
Users that are interested in cuda-by-example are comparing it to the libraries listed below
Sorting:
- CUDA Matrix Multiplication Optimization☆201Updated 11 months ago
- A set of hands-on tutorials for CUDA programming☆230Updated last year
- Step-by-step optimization of CUDA SGEMM☆355Updated 3 years ago
- Some CUDA design patterns and a bit of template magic for CUDA☆155Updated 2 years ago
- LLM training in simple, raw C/CUDA☆99Updated last year
- Standalone Flash Attention v2 kernel without libtorch dependency☆110Updated 10 months ago
- CUDA by Example, written by two senior members of the CUDA software platform team, shows programmers how to employ this new technology. …☆427Updated 2 years ago
- Official Problem Sets / Reference Kernels for the GPU MODE Leaderboard!☆62Updated 2 weeks ago
- Examples from Programming in Parallel with CUDA☆157Updated 2 years ago
- A faster implementation of OpenCV-CUDA that uses OpenCV objects, and more!☆51Updated last week
- Learning and practice of high performance computing (CUDA, Vulkan, OpenCL, OpenMP, TBB, SSE/AVX, NEON, MPI, coroutines, etc. )☆60Updated 3 months ago
- A Visual Studio Code extension for building and debugging CUDA applications.☆82Updated 2 weeks ago
- CUDA 6大并行计算模式 代码与笔记☆60Updated 4 years ago
- Implement Neural Networks in Cuda from Scratch☆23Updated last year
- ⚡️FFPA: Extend FlashAttention-2 with Split-D, achieve ~O(1) SRAM complexity for large headdim, 1.8x~3x↑ vs SDPA.🎉☆189Updated 2 months ago
- ☆171Updated last year
- The CUDA version of the RWKV language model ( https://github.com/BlinkDL/RWKV-LM )☆221Updated 7 months ago
- ☆60Updated 2 years ago
- High-speed GEMV kernels, at most 2.7x speedup compared to pytorch baseline.☆112Updated last year
- ☆50Updated last year
- SGEMM optimization with cuda step by step☆20Updated last year
- Learn OpenMP examples step by step☆95Updated 5 months ago
- The NVIDIA® Tools Extension SDK (NVTX) is a C-based Application Programming Interface (API) for annotating events, code ranges, and resou…☆413Updated 2 weeks ago
- FP64 equivalent GEMM via Int8 Tensor Cores using the Ozaki scheme☆76Updated 3 months ago
- cuda编程学习入门☆35Updated 11 months ago
- ☆447Updated 10 years ago
- ⚡️Write HGEMM from scratch using Tensor Cores with WMMA, MMA and CuTe API, Achieve Peak⚡️ Performance.☆86Updated 2 months ago
- ☆31Updated 5 months ago
- JaxPP is a library for JAX that enables flexible MPMD pipeline parallelism for large-scale LLM training☆51Updated last week
- Unified compiler/runtime for interfacing with PyTorch Dynamo.☆100Updated last week