Alternatives and similar repositories for NCCL

Users that are interested in NCCL are comparing it to the libraries listed below

• wzsh / wmma_tensorcore_sample
  Matrix Multiply-Accumulate with CUDA and WMMA( Tensor Core)
  ☆146Updated 5 years ago
• ColfaxResearch / cfx-article-src
  ☆163Updated 7 months ago
• muriloboratto / NVSHEMEM
  Sample Codes using NVSHMEM on Multi-GPU
  ☆30Updated 2 years ago
• wmmae / wmma_extension
  An extension library of WMMA API (Tensor Core API)
  ☆109Updated last year
• FZJ-JSC / tutorial-multi-gpu
  Efficient Distributed GPU Programming for Exascale, an SC/ISC Tutorial
  ☆340Updated 2 weeks ago
• CalebDu / Awesome-Cute
  ☆112Updated 7 months ago
• 1duo / nccl-examples
  NCCL Examples from Official NVIDIA NCCL Developer Guide.
  ☆19Updated 7 years ago
• cwpearson / nvidia-performance-tools
  Instructions, Docker images, and examples for Nsight Compute and Nsight Systems
  ☆134Updated 5 years ago
• infinigence / FlashOverlap
  A lightweight design for computation-communication overlap.
  ☆196Updated 2 months ago
• c3sr / tcu_scope
  ☆50Updated 6 years ago
• gty111 / GEMM_MMA
  Optimize GEMM with tensorcore step by step
  ☆36Updated 2 years ago
• KuangjuX / NVSHMEM-Tutorial
  NVSHMEM‑Tutorial: Build a DeepEP‑like GPU Buffer
  ☆146Updated 3 months ago
• Oneflow-Inc / dfccl
  ☆26Updated 10 months ago
• temporal-hpc / reduction-tensor-cores
  Fast GPU based tensor core reductions
  ☆13Updated 2 years ago
• sunlex0717 / DissectingTensorCores
  ☆110Updated last year
• flagos-ai / flagtree
  FlagTree is a unified compiler supporting multiple AI chip backends for custom Deep Learning operations, which is forked from triton-lang…
  ☆146Updated this week
• Bruce-Lee-LY / cuda_hgemv
  Several optimization methods of half-precision general matrix vector multiplication (HGEMV) using CUDA core.
  ☆70Updated last year
• leimao / CUDA-GEMM-Optimization
  CUDA Matrix Multiplication Optimization
  ☆245Updated last year
• reed-lau / cute-gemm
  ☆155Updated last month
• ROCm / rocSHMEM
  rocSHMEM intra-kernel networking runtime for AMD dGPUs on the ROCm platform.
  ☆133Updated this week
• leimao / CUTLASS-Examples
  CUTLASS and CuTe Examples
  ☆112Updated 2 weeks ago
• xlite-dev / HGEMM
  ⚡️Write HGEMM from scratch using Tensor Cores with WMMA, MMA and CuTe API, Achieve Peak⚡️ Performance.
  ☆137Updated 7 months ago
• NVIDIA / nsight-training
  Training material for Nsight developer tools
  ☆173Updated last year
• sjfeng1999 / gpu-arch-microbenchmark
  Dissecting NVIDIA GPU Architecture
  ☆115Updated 3 years ago
• rchardx / cuda-gemm
  ☆39Updated last month
• AlibabaPAI / FLASHNN
  ☆103Updated last year
• eth-cscs / Tiled-MM
  Matrix multiplication on GPUs for matrices stored on a CPU. Similar to cublasXt, but ported to both NVIDIA and AMD GPUs.
  ☆32Updated 8 months ago
• microsoft / ConvStencil
  ☆34Updated last year
• merthidayetoglu / HiCCL
  A hierarchical collective communications library with portable optimizations
  ☆37Updated last year
• Bruce-Lee-LY / flash_attention_inference
  Performance of the C++ interface of flash attention and flash attention v2 in large language model (LLM) inference scenarios.
  ☆43Updated 9 months ago