YinLiu-91 / ncclOperationPlus
use ncclSend ncclRecv realize ncclSendrecv ncclGather ncclScatter ncclAlltoall
☆8Updated 2 years ago
Related projects ⓘ
Alternatives and complementary repositories for ncclOperationPlus
- Sample examples of how to call collective operation functions on multi-GPU environments. A simple example of using broadcast, reduce, all…☆25Updated last year
- ☆41Updated 4 years ago
- NCCL Examples from Official NVIDIA NCCL Developer Guide.☆13Updated 6 years ago
- Implementation and analysis of five different GPU based SPMV algorithms in CUDA☆35Updated 5 years ago
- Efficient Distributed GPU Programming for Exascale, an SC/ISC Tutorial☆188Updated this week
- A highly efficient library for GEMM operations on Sunway TaihuLight☆14Updated 4 years ago
- Matrix multiplication on GPUs for matrices stored on a CPU. Similar to cublasXt, but ported to both NVIDIA and AMD GPUs.☆29Updated 2 months ago
- NUMA-aware multi-CPU multi-GPU data transfer benchmarks☆21Updated last year
- example code for using DC QP for providing RDMA READ and WRITE operations to remote GPU memory☆104Updated 3 months ago
- Implementation of TSM2L and TSM2R -- High-Performance Tall-and-Skinny Matrix-Matrix Multiplication Algorithms for CUDA☆31Updated 4 years ago
- benchmark for linux server☆13Updated 8 years ago
- Tartan: Evaluating Modern GPU Interconnect via a Multi-GPU Benchmark Suite☆60Updated 6 years ago
- Matrix Multiply-Accumulate with CUDA and WMMA( Tensor Core)☆116Updated 4 years ago
- Mellanox libibverbs☆58Updated 5 years ago
- A Simple RDMA Wheel☆22Updated 5 years ago
- A hierarchical collective communications library with portable optimizations☆23Updated 4 months ago
- ☆15Updated 5 years ago
- Personal Notes for Learning HPC & Parallel Computation [Active Adding New Content]☆59Updated 2 years ago
- ☆23Updated 2 years ago
- Source code of the PPoPP '22 paper: "TileSpGEMM: A Tiled Algorithm for Parallel Sparse General Matrix-Matrix Multiplication on GPUs" by Y…☆38Updated 6 months ago
- ☆24Updated 7 months ago
- ☆116Updated last year
- TACCL: Guiding Collective Algorithm Synthesis using Communication Sketches☆64Updated last year
- A sparse BLAS lib supporting multiple backends☆40Updated this week
- Fast Synchronization-Free Algorithms for Parallel Sparse Triangular Solves with Multiple Right-Hand Sides (SpTRSM)☆12Updated 4 years ago
- The Task-Aware MPI (TAMPI) library extends the functionality of standard MPI libraries by providing new mechanisms for improving the inte…☆23Updated last week
- ☆44Updated 5 years ago
- CSR-based SpGEMM on nVidia and AMD GPUs☆45Updated 8 years ago
- Paella: Low-latency Model Serving with Virtualized GPU Scheduling☆57Updated 6 months ago
- CSR5-based SpMV on CPUs, GPUs and Xeon Phi☆95Updated 5 months ago