Alternatives and similar repositories for msccl

Users that are interested in msccl are comparing it to the libraries listed below

• microsoft / msccl-tools
  Synthesizer for optimal collective communication algorithms
  ☆121Updated last year
• microsoft / NPKit
  NCCL Profiling Kit
  ☆149Updated last year
• microsoft / mscclpp
  MSCCL++: A GPU-driven communication stack for scalable AI applications
  ☆444Updated this week
• Mellanox / nccl-rdma-sharp-plugins
  RDMA and SHARP plugins for nccl library
  ☆217Updated last month
• google / nccl-fastsocket
  NCCL Fast Socket is a transport layer plugin to improve NCCL collective communication performance on Google Cloud.
  ☆122Updated 2 years ago
• parasailteam / coconet
  ☆83Updated 3 years ago
• microsoft / taccl
  TACCL: Guiding Collective Algorithm Synthesis using Communication Sketches
  ☆78Updated 2 years ago
• calculon-ai / calculon
  ☆165Updated last year
• Azure / msccl
  Microsoft Collective Communication Library
  ☆66Updated last year
• AlibabaPAI / DAPPLE
  An Efficient Pipelined Data Parallel Approach for Training Large Model
  ☆76Updated 5 years ago
• mcrl / tccl
  Thunder Research Group's Collective Communication Library
  ☆43Updated 5 months ago
• ConnollyLeon / awesome-Auto-Parallelism
  A baseline repository of Auto-Parallelism in Training Neural Networks
  ☆147Updated 3 years ago
• facebookresearch / param
  PArametrized Recommendation and Ai Model benchmark is a repository for development of numerous uBenchmarks as well as end to end nets for…
  ☆154Updated last week
• mlcommons / chakra
  Repository for MLCommons Chakra schema and tools
  ☆143Updated last month
• zartbot / shallowsim
  DeepSeek-V3/R1 inference performance simulator
  ☆172Updated 8 months ago
• microsoft / SuperScaler
  An experimental parallel training platform
  ☆56Updated last year
• alpa-projects / mms
  AlpaServe: Statistical Multiplexing with Model Parallelism for Deep Learning Serving (OSDI 23)
  ☆92Updated 2 years ago
• eth-easl / orion
  An interference-aware scheduler for fine-grained GPU sharing
  ☆154Updated 3 weeks ago
• microsoft / superbenchmark
  A validation and profiling tool for AI infrastructure
  ☆352Updated this week
• Mellanox / nv_peer_memory
  ☆379Updated last year
• Mellanox / gpu_direct_rdma_access
  example code for using DC QP for providing RDMA READ and WRITE operations to remote GPU memory
  ☆150Updated last year
• eniac / paella
  Paella: Low-latency Model Serving with Virtualized GPU Scheduling
  ☆66Updated last year
• NVIDIA / nvbandwidth
  A tool for bandwidth measurements on NVIDIA GPUs.
  ☆583Updated 8 months ago
• SJTU-IPADS / reef
  REEF is a GPU-accelerated DNN inference serving system that enables instant kernel preemption and biased concurrent execution in GPU sche…
  ☆102Updated 2 years ago
• SymbioticLab / Salus
  Fine-grained GPU sharing primitives
  ☆147Updated 4 months ago
• hyxcl / nsys_recipes
  these are custom recipes of nvidia nsight system post collection analysis.
  ☆15Updated last month
• infinigence / FlashOverlap
  A lightweight design for computation-communication overlap.
  ☆196Updated 2 months ago
• atomicapple0 / libsmctrl
  Artifact from "Hardware Compute Partitioning on NVIDIA GPUs". THIS IS A FORK OF BAKITAS REPO. I AM NOT ONE OF THE AUTHORS OF THE PAPER.
  ☆46Updated 3 weeks ago
• HPMLL / BurstGPT
  A ChatGPT(GPT-3.5) & GPT-4 Workload Trace to Optimize LLM Serving Systems
  ☆226Updated 4 months ago
• openucx / ucc
  Unified Collective Communication Library
  ☆282Updated last week