Microsoft Collective Communication Library
☆400Aug 25, 2026Updated 2 months ago
Alternatives and similar repositories for msccl
Users that are interested in msccl are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Synthesizer for optimal collective communication algorithms☆126Apr 8, 2024Updated 2 years ago
- MSCCL++: A GPU-driven communication stack for scalable AI applications☆566Updated this week
- TACCL: Guiding Collective Algorithm Synthesis using Communication Sketches☆87Jul 25, 2023Updated 3 years ago
- NCCL Profiling Kit☆156Jul 1, 2024Updated 2 years ago
- Microsoft Collective Communication Library☆67Nov 23, 2024Updated last year
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- ☆84Dec 2, 2022Updated 3 years ago
- RDMA and SHARP plugins for nccl library☆232Aug 12, 2026Updated 2 months ago
- Unified Collective Communication Library☆317Oct 19, 2026Updated last week
- [DEPRECATED] Moved to ROCm/rocm-systems repo☆420Updated this week
- Optimized primitives for collective multi-GPU communication☆5,187Updated this week
- NCCL Fast Socket is a transport layer plugin to improve NCCL collective communication performance on Google Cloud.☆125Nov 15, 2023Updated 2 years ago
- Tutel MoE: Optimized Mixture-of-Experts Library, Support GLM/Kimi/Gpt/DeepSeek/Qwen using FP8/NVFP4/MXFP4☆1,030Oct 21, 2026Updated last week
- NCCL Tests☆1,681Oct 5, 2026Updated 3 weeks ago
- ☆401Apr 23, 2024Updated 2 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- ☆27Feb 17, 2025Updated last year
- Thunder Research Group's Collective Communication Library☆53Jul 8, 2025Updated last year
- ASTRA-sim2.0: Modeling Hierarchical Networks and Disaggregated Systems for Large-model Training at Scale☆711Sep 19, 2026Updated last month
- A fast communication-overlapping library for tensor/expert parallelism on GPUs.☆1,375Aug 28, 2025Updated last year
- Distributed Compiler and Optimized Parallel Kernels☆1,573Sep 18, 2026Updated last month
- A GPU-driven system framework for scalable AI applications☆133Aug 20, 2026Updated 2 months ago
- Byted PyTorch Distributed for Hyperscale Training of LLMs and RLs☆1,043Mar 3, 2026Updated 7 months ago
- ☆57Aug 27, 2024Updated 2 years ago
- Automatically Discovering Fast Parallelization Strategies for Distributed Deep Neural Network Training☆1,903Updated this week
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- A fast GPU memory copy library based on NVIDIA GPUDirect RDMA technology☆1,428Sep 15, 2026Updated last month
- UCCL is an efficient communication library for GPUs, covering collectives, P2P (e.g., KV cache transfer, RL weight transfer), and EP (e.g…☆1,554Updated this week
- This is a plugin which lets EC2 developers use libfabric as network provider while running NCCL applications.☆238Oct 21, 2026Updated last week
- torchcomms: a modern PyTorch communications API☆402Updated this week
- ☆396Nov 4, 2022Updated 3 years ago
- ☆22Jun 1, 2026Updated 4 months ago
- Bamboo is a system for running large pipeline-parallel DNNs affordably, reliably, and efficiently using spot instances.☆55Dec 11, 2022Updated 3 years ago
- ☆25Nov 12, 2025Updated 11 months ago
- A resilient distributed training framework☆101Jul 24, 2026Updated 3 months ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Alveo Collective Communication Library: MPI-like communication operations for Xilinx Alveo accelerators☆111Jun 30, 2025Updated last year
- Managed collective communication service☆24Sep 2, 2024Updated 2 years ago
- ☆47Dec 13, 2024Updated last year
- PArametrized Recommendation and Ai Model benchmark is a repository for development of numerous uBenchmarks as well as end to end nets for…☆156Updated this week
- TACOS: [T]opology-[A]ware [Co]llective Algorithm [S]ynthesizer for Distributed Machine Learning☆38Jun 13, 2025Updated last year
- Training and serving large-scale neural networks with auto parallelization.☆3,177Dec 9, 2023Updated 2 years ago
- ☆43Sep 6, 2021Updated 5 years ago