Alternatives and similar repositories for msccl:

Users that are interested in msccl are comparing it to the libraries listed below

• microsoft / mscclpp
  MSCCL++: A GPU-driven communication stack for scalable AI applications
  ☆311Updated this week
• microsoft / NPKit
  NCCL Profiling Kit
  ☆127Updated 8 months ago
• microsoft / msccl-tools
  Synthesizer for optimal collective communication algorithms
  ☆106Updated 11 months ago
• Mellanox / nccl-rdma-sharp-plugins
  RDMA and SHARP plugins for nccl library
  ☆183Updated last month
• google / nccl-fastsocket
  NCCL Fast Socket is a transport layer plugin to improve NCCL collective communication performance on Google Cloud.
  ☆116Updated last year
• Azure / msccl
  Microsoft Collective Communication Library
  ☆60Updated 3 months ago
• parasailteam / coconet
  ☆75Updated 2 years ago
• calculon-ai / calculon
  ☆131Updated last year
• ConnollyLeon / awesome-Auto-Parallelism
  A baseline repository of Auto-Parallelism in Training Neural Networks
  ☆143Updated 2 years ago
• microsoft / taccl
  TACCL: Guiding Collective Algorithm Synthesis using Communication Sketches
  ☆71Updated last year
• AlibabaPAI / DAPPLE
  An Efficient Pipelined Data Parallel Approach for Training Large Model
  ☆74Updated 4 years ago
• microsoft / triton-shared
  Shared Middle-Layer for Triton Compilation
  ☆232Updated last week
• microsoft / nnscaler
  nnScaler: Compiling DNN models for Parallel Training
  ☆101Updated last month
• NVIDIA / nvbandwidth
  A tool for bandwidth measurements on NVIDIA GPUs.
  ☆391Updated last month
• mlcommons / chakra
  Repository for MLCommons Chakra schema and tools
  ☆92Updated last week
• facebookresearch / param
  PArametrized Recommendation and Ai Model benchmark is a repository for development of numerous uBenchmarks as well as end to end nets for…
  ☆132Updated this week
• microsoft / vattention
  Dynamic Memory Management for Serving LLMs without PagedAttention
  ☆317Updated this week
• Mellanox / nv_peer_memory
  ☆330Updated 10 months ago
• HPDL-Group / Merak
  ☆79Updated 3 months ago
• microsoft / SuperScaler
  An experimental parallel training platform
  ☆54Updated 11 months ago
• astra-sim / astra-sim
  ASTRA-sim2.0: Modeling Hierarchical Networks and Disaggregated Systems for Large-model Training at Scale
  ☆327Updated 3 weeks ago
• RRZE-HPC / gpu-benches
  collection of benchmarks to measure basic GPU capabilities
  ☆308Updated last month
• eth-easl / orion
  An interference-aware scheduler for fine-grained GPU sharing
  ☆127Updated last month
• HPMLL / BurstGPT
  A ChatGPT(GPT-3.5) & GPT-4 Workload Trace to Optimize LLM Serving Systems
  ☆153Updated 5 months ago
• microsoft / superbenchmark
  A validation and profiling tool for AI infrastructure
  ☆302Updated this week
• openucx / ucc
  Unified Collective Communication Library
  ☆237Updated this week
• Mutinifni / splitwise-sim
  LLM serving cluster simulator
  ☆93Updated 10 months ago
• sail-sg / zero-bubble-pipeline-parallelism
  Zero Bubble Pipeline Parallelism
  ☆370Updated 2 weeks ago
• ROCm / rccl
  ROCm Communication Collectives Library (RCCL)
  ☆305Updated this week