muriloboratto / NCCL
Sample examples of how to call collective operation functions on multi-GPU environments. A simple example of using broadcast, reduce, allGather, reduceScatter and sendRecv operations.
☆22Updated last year
Related projects: ⓘ
- Matrix Multiply-Accumulate with CUDA and WMMA( Tensor Core)☆109Updated 4 years ago
- ☆44Updated 5 years ago
- ☆39Updated 4 years ago
- Fast GPU based tensor core reductions☆11Updated last year
- Magicube is a high-performance library for quantized sparse matrix operations (SpMM and SDDMM) of deep learning on Tensor Cores.☆79Updated last year
- A highly efficient library for GEMM operations on Sunway TaihuLight☆14Updated 4 years ago
- ☆30Updated 2 years ago
- Implementation of TSM2L and TSM2R -- High-Performance Tall-and-Skinny Matrix-Matrix Multiplication Algorithms for CUDA☆31Updated 4 years ago
- Some source code about matrix multiplication implementation on CUDA☆35Updated 6 years ago
- Source code of the PPoPP '22 paper: "TileSpGEMM: A Tiled Algorithm for Parallel Sparse General Matrix-Matrix Multiplication on GPUs" by Y…☆35Updated 3 months ago
- An extension library of WMMA API (Tensor Core API)☆81Updated 2 months ago
- ☆72Updated last year
- A sparse BLAS lib supporting multiple backends☆38Updated 7 months ago
- Instructions, Docker images, and examples for Nsight Compute and Nsight Systems☆126Updated 4 years ago
- Dissecting NVIDIA GPU Architecture☆78Updated 2 years ago
- Tartan: Evaluating Modern GPU Interconnect via a Multi-GPU Benchmark Suite☆57Updated 6 years ago
- ☆19Updated 5 months ago
- ☆38Updated 4 years ago
- Efficient Distributed GPU Programming for Exascale, an SC/ISC Tutorial☆165Updated 3 months ago
- ☆14Updated 5 years ago
- Samples demonstrating how to use the Compute Sanitizer Tools and Public API☆56Updated 10 months ago
- ☆73Updated 5 months ago
- ☆15Updated 3 months ago
- GVProf: A Value Profiler for GPU-based Clusters☆46Updated 5 months ago
- CSR-based SpGEMM on nVidia and AMD GPUs☆45Updated 8 years ago
- GPU Performance Advisor☆58Updated 2 years ago
- CUDA Matrix Multiplication Optimization☆118Updated 2 months ago
- GPU TopK Benchmark☆14Updated last year
- Source code of the SC '23 paper: "DASP: Specific Dense Matrix Multiply-Accumulate Units Accelerated General Sparse Matrix-Vector Multipli…☆16Updated 3 months ago
- ☆95Updated 2 years ago