Alternatives and similar repositories for nccl

Users that are interested in nccl are comparing it to the libraries listed below

• facebookresearch / param
  PArametrized Recommendation and Ai Model benchmark is a repository for development of numerous uBenchmarks as well as end to end nets for…
  ☆154Updated this week
• aws / aws-ofi-nccl
  This is a plugin which lets EC2 developers use libfabric as network provider while running NCCL applications.
  ☆200Updated this week
• ROCm / rccl-tests
  RCCL Performance Benchmark Tests
  ☆81Updated last week
• NVIDIA / cloudai
  CloudAI Benchmark Framework
  ☆76Updated this week
• openucx / ucc
  Unified Collective Communication Library
  ☆280Updated last week
• microsoft / NPKit
  NCCL Profiling Kit
  ☆149Updated last year
• Azure / msccl-executor-nccl
  ☆47Updated last year
• Infrawaves / DeepEP_ibrc_dual-ports_multiQP
  Aims to implement dual-port and multi-qp solutions in deepEP ibrc transport
  ☆70Updated 7 months ago
• google / nccl-fastsocket
  NCCL Fast Socket is a transport layer plugin to improve NCCL collective communication performance on Google Cloud.
  ☆122Updated 2 years ago
• Azure / msccl
  Microsoft Collective Communication Library
  ☆66Updated last year
• uxlfoundation / oneCCL
  oneAPI Collective Communications Library (oneCCL)
  ☆249Updated this week
• ROCm / rocSHMEM
  rocSHMEM intra-kernel networking runtime for AMD dGPUs on the ROCm platform.
  ☆131Updated this week
• ROCm / rccl
  ROCm Communication Collectives Library (RCCL)
  ☆404Updated this week
• NVIDIA / ib-traffic-monitor
  A TUI-based utility for real-time monitoring of InfiniBand traffic and performance metrics on the local node
  ☆46Updated 3 months ago
• NVIDIA / nvshmem
  NVIDIA NVSHMEM is a parallel programming interface for NVIDIA GPUs based on OpenSHMEM. NVSHMEM can significantly reduce multi-process com…
  ☆407Updated last month
• ROCm / rocm_bandwidth_test
  Bandwidth test for ROCm
  ☆71Updated this week
• microsoft / ark
  A GPU-driven system framework for scalable AI applications
  ☆122Updated 10 months ago
• merthidayetoglu / HiCCL
  A hierarchical collective communications library with portable optimizations
  ☆37Updated last year
• intel / torch-ccl
  oneCCL Bindings for Pytorch* (deprecated)
  ☆103Updated last month
• microsoft / mscclpp
  MSCCL++: A GPU-driven communication stack for scalable AI applications
  ☆442Updated this week
• perplexityai / pplx-garden
  Perplexity open source garden for inference technology
  ☆295Updated last week
• Mellanox / nccl-rdma-sharp-plugins
  RDMA and SHARP plugins for nccl library
  ☆217Updated 3 weeks ago
• openucx / torch-ucc
  pytorch ucc plugin
  ☆23Updated 4 years ago
• NVIDIA / nvidia-resiliency-ext
  NVIDIA Resiliency Extension is a python package for framework developers and users to implement fault-tolerant features. It improves the …
  ☆239Updated last week
• NVIDIA / nvbandwidth
  A tool for bandwidth measurements on NVIDIA GPUs.
  ☆580Updated 8 months ago
• coreweave / nccl-tests
  NVIDIA NCCL Tests for Distributed Training
  ☆129Updated this week
• vllm-project / flash-attention
  Fast and memory-efficient exact attention
  ☆104Updated this week
• ROCm / aiter
  AI Tensor Engine for ROCm
  ☆311Updated last week
• gpudirect / libgdsync
  GPUDirect Async support for IB Verbs
  ☆133Updated 3 years ago
• meta-pytorch / torchcomms
  torchcomms: a modern PyTorch communications API
  ☆302Updated this week