Alternatives and similar repositories for msccl:

Users that are interested in msccl are comparing it to the libraries listed below

• microsoft / msccl-tools
  Synthesizer for optimal collective communication algorithms
  ☆105Updated last year
• microsoft / mscclpp
  MSCCL++: A GPU-driven communication stack for scalable AI applications
  ☆330Updated this week
• microsoft / NPKit
  NCCL Profiling Kit
  ☆129Updated 9 months ago
• Mellanox / nccl-rdma-sharp-plugins
  RDMA and SHARP plugins for nccl library
  ☆187Updated this week
• google / nccl-fastsocket
  NCCL Fast Socket is a transport layer plugin to improve NCCL collective communication performance on Google Cloud.
  ☆116Updated last year
• parasailteam / coconet
  ☆78Updated 2 years ago
• microsoft / taccl
  TACCL: Guiding Collective Algorithm Synthesis using Communication Sketches
  ☆72Updated last year
• Azure / msccl
  Microsoft Collective Communication Library
  ☆65Updated 4 months ago
• calculon-ai / calculon
  ☆133Updated last year
• microsoft / vattention
  Dynamic Memory Management for Serving LLMs without PagedAttention
  ☆345Updated 3 weeks ago
• mlcommons / chakra
  Repository for MLCommons Chakra schema and tools
  ☆95Updated last month
• zartbot / shallowsim
  DeepSeek-V3/R1 inference performance simulator
  ☆102Updated 2 weeks ago
• ConnollyLeon / awesome-Auto-Parallelism
  A baseline repository of Auto-Parallelism in Training Neural Networks
  ☆143Updated 2 years ago
• ai-dynamo / nixl
  NVIDIA Inference Xfer Library (NIXL)
  ☆242Updated this week
• microsoft / triton-shared
  Shared Middle-Layer for Triton Compilation
  ☆241Updated this week
• NVIDIA / nvbandwidth
  A tool for bandwidth measurements on NVIDIA GPUs.
  ☆397Updated 2 months ago
• yifuwang / symm-mem-recipes
  ☆64Updated 3 months ago
• microsoft / sarathi-serve
  A low-latency & high-throughput serving engine for LLMs
  ☆337Updated 2 months ago
• bytedance / ByteMLPerf
  AI Accelerator Benchmark focuses on evaluating AI Accelerators from a practical production perspective, including the ease of use and ver…
  ☆231Updated 3 weeks ago
• microsoft / nnscaler
  nnScaler: Compiling DNN models for Parallel Training
  ☆106Updated 2 months ago
• microsoft / SuperScaler
  An experimental parallel training platform
  ☆54Updated last year
• alpa-projects / mms
  AlpaServe: Statistical Multiplexing with Model Parallelism for Deep Learning Serving (OSDI 23)
  ☆81Updated last year
• astra-sim / astra-sim
  ASTRA-sim2.0: Modeling Hierarchical Networks and Disaggregated Systems for Large-model Training at Scale
  ☆340Updated last week
• Mellanox / nv_peer_memory
  ☆336Updated 11 months ago
• AlibabaPAI / DAPPLE
  An Efficient Pipelined Data Parallel Approach for Training Large Model
  ☆73Updated 4 years ago
• facebookresearch / param
  PArametrized Recommendation and Ai Model benchmark is a repository for development of numerous uBenchmarks as well as end to end nets for…
  ☆134Updated this week
• daadaada / turingas
  Assembler for NVIDIA Volta and Turing GPUs
  ☆215Updated 3 years ago
• eniac / paella
  Paella: Low-latency Model Serving with Virtualized GPU Scheduling
  ☆58Updated 11 months ago
• ParCIS / Chimera
  Chimera: bidirectional pipeline parallelism for efficiently training large-scale models.
  ☆61Updated 3 weeks ago
• microsoft / superbenchmark
  A validation and profiling tool for AI infrastructure
  ☆306Updated this week