muriloboratto / NCCL
Sample examples of how to call collective operation functions on multi-GPU environments. A simple example of using broadcast, reduce, allGather, reduceScatter and sendRecv operations.
☆25Updated last year
Related projects ⓘ
Alternatives and complementary repositories for NCCL
- ☆44Updated 5 years ago
- Matrix Multiply-Accumulate with CUDA and WMMA( Tensor Core)☆116Updated 4 years ago
- Implementation of TSM2L and TSM2R -- High-Performance Tall-and-Skinny Matrix-Matrix Multiplication Algorithms for CUDA☆31Updated 4 years ago
- ☆41Updated 4 years ago
- ☆79Updated 8 months ago
- NCCL Examples from Official NVIDIA NCCL Developer Guide.☆13Updated 6 years ago
- TiledCUDA is a highly efficient kernel template library designed to elevate CUDA C’s level of abstraction for processing tiles.☆156Updated this week
- ☆80Updated 7 months ago
- ☆110Updated 2 years ago
- ☆24Updated 7 months ago
- An extension library of WMMA API (Tensor Core API)☆84Updated 4 months ago
- ☆73Updated last year
- ☆15Updated 5 years ago
- Dissecting NVIDIA GPU Architecture☆82Updated 2 years ago
- Some source code about matrix multiplication implementation on CUDA☆35Updated 6 years ago
- Examples of CUDA implementations by Cutlass CuTe☆98Updated last week
- Magicube is a high-performance library for quantized sparse matrix operations (SpMM and SDDMM) of deep learning on Tensor Cores.☆81Updated last year
- ☆48Updated this week
- ☆103Updated 7 months ago
- Instructions, Docker images, and examples for Nsight Compute and Nsight Systems☆128Updated 4 years ago
- ☆11Updated last year
- ☆138Updated 2 weeks ago
- ☆38Updated 4 years ago
- Fast GPU based tensor core reductions☆11Updated last year
- ☆165Updated this week
- GPU TopK Benchmark☆14Updated last year
- Benchmark code for the "Online normalizer calculation for softmax" paper☆59Updated 6 years ago
- Yinghan's Code Sample☆289Updated 2 years ago
- Efficient Distributed GPU Programming for Exascale, an SC/ISC Tutorial☆188Updated this week
- An unofficial cuda assembler, for all generations of SASS, hopefully :)☆78Updated last year