Alternatives and similar repositories for msccl

Users that are interested in msccl are comparing it to the libraries listed below

• microsoft / msccl-tools
  Synthesizer for optimal collective communication algorithms
  ☆119Updated last year
• microsoft / mscclpp
  MSCCL++: A GPU-driven communication stack for scalable AI applications
  ☆433Updated this week
• microsoft / NPKit
  NCCL Profiling Kit
  ☆145Updated last year
• Mellanox / nccl-rdma-sharp-plugins
  RDMA and SHARP plugins for nccl library
  ☆212Updated 3 weeks ago
• google / nccl-fastsocket
  NCCL Fast Socket is a transport layer plugin to improve NCCL collective communication performance on Google Cloud.
  ☆122Updated last year
• parasailteam / coconet
  ☆83Updated 2 years ago
• microsoft / taccl
  TACCL: Guiding Collective Algorithm Synthesis using Communication Sketches
  ☆76Updated 2 years ago
• calculon-ai / calculon
  ☆156Updated last year
• ConnollyLeon / awesome-Auto-Parallelism
  A baseline repository of Auto-Parallelism in Training Neural Networks
  ☆147Updated 3 years ago
• mlcommons / chakra
  Repository for MLCommons Chakra schema and tools
  ☆137Updated 2 weeks ago
• AlibabaPAI / DAPPLE
  An Efficient Pipelined Data Parallel Approach for Training Large Model
  ☆76Updated 4 years ago
• Azure / msccl
  Microsoft Collective Communication Library
  ☆66Updated 11 months ago
• zartbot / shallowsim
  DeepSeek-V3/R1 inference performance simulator
  ☆168Updated 7 months ago
• Mellanox / nv_peer_memory
  ☆377Updated last year
• microsoft / SuperScaler
  An experimental parallel training platform
  ☆56Updated last year
• mcrl / tccl
  Thunder Research Group's Collective Communication Library
  ☆42Updated 4 months ago
• microsoft / nnscaler
  nnScaler: Compiling DNN models for Parallel Training
  ☆118Updated last month
• SymbioticLab / Salus
  Fine-grained GPU sharing primitives
  ☆146Updated 3 months ago
• SJTU-IPADS / reef
  REEF is a GPU-accelerated DNN inference serving system that enables instant kernel preemption and biased concurrent execution in GPU sche…
  ☆102Updated 2 years ago
• facebookresearch / param
  PArametrized Recommendation and Ai Model benchmark is a repository for development of numerous uBenchmarks as well as end to end nets for…
  ☆153Updated this week
• NVIDIA / nvbandwidth
  A tool for bandwidth measurements on NVIDIA GPUs.
  ☆564Updated 6 months ago
• astra-sim / astra-sim
  ASTRA-sim2.0: Modeling Hierarchical Networks and Disaggregated Systems for Large-model Training at Scale
  ☆459Updated this week
• Mellanox / gpu_direct_rdma_access
  example code for using DC QP for providing RDMA READ and WRITE operations to remote GPU memory
  ☆145Updated last year
• eniac / paella
  Paella: Low-latency Model Serving with Virtualized GPU Scheduling
  ☆62Updated last year
• eth-easl / orion
  An interference-aware scheduler for fine-grained GPU sharing
  ☆150Updated 9 months ago
• alpa-projects / mms
  AlpaServe: Statistical Multiplexing with Model Parallelism for Deep Learning Serving (OSDI 23)
  ☆89Updated 2 years ago
• infinigence / FlashOverlap
  A lightweight design for computation-communication overlap.
  ☆183Updated last month
• openucx / ucc
  Unified Collective Communication Library
  ☆278Updated last week
• ParCIS / Chimera
  Chimera: bidirectional pipeline parallelism for efficiently training large-scale models.
  ☆67Updated 7 months ago
• HPMLL / BurstGPT
  A ChatGPT(GPT-3.5) & GPT-4 Workload Trace to Optimize LLM Serving Systems
  ☆218Updated 3 months ago