Microsoft Collective Communication Library
☆66Nov 23, 2024Updated last year
Alternatives and similar repositories for msccl
Users that are interested in msccl are comparing it to the libraries listed below
Sorting:
- NCCL Profiling Kit☆152Jul 1, 2024Updated last year
- Synthesizer for optimal collective communication algorithms☆124Apr 8, 2024Updated last year
- Microsoft Collective Communication Library☆384Sep 20, 2023Updated 2 years ago
- MSCCL++: A GPU-driven communication stack for scalable AI applications☆469Feb 21, 2026Updated last week
- ☆49Aug 27, 2024Updated last year
- TACCL: Guiding Collective Algorithm Synthesis using Communication Sketches☆80Jul 25, 2023Updated 2 years ago
- ☆47Dec 13, 2024Updated last year
- TACOS: [T]opology-[A]ware [Co]llective Algorithm [S]ynthesizer for Distributed Machine Learning☆32Jun 13, 2025Updated 8 months ago
- [DEPRECATED] Moved to ROCm/rocm-systems repo☆144Updated this week
- [DEPRECATED] Moved to ROCm/rocm-systems repo☆411Updated this week
- SMT-LIB benchmarks for shape computations from deep learning models in PyTorch☆18Dec 21, 2022Updated 3 years ago
- ☆53Feb 1, 2026Updated 3 weeks ago
- [DEPRECATED] Moved to ROCm/rocm-systems repo☆86Feb 11, 2026Updated 2 weeks ago
- ☆84Dec 2, 2022Updated 3 years ago
- GPU Affinity is a package to automatically set the CPU process affinity to match the hardware architecture on a given platform☆29Dec 8, 2023Updated 2 years ago
- Repository for MLCommons Chakra schema and tools☆39Dec 24, 2023Updated 2 years ago
- NCCL Fast Socket is a transport layer plugin to improve NCCL collective communication performance on Google Cloud.☆122Nov 15, 2023Updated 2 years ago
- Byted PyTorch Distributed for Hyperscale Training of LLMs and RLs☆938Nov 27, 2025Updated 3 months ago
- ☆11Dec 9, 2025Updated 2 months ago
- Code for the SIGMOD 2018 programming contest. Finished at 2nd place.☆13Jun 6, 2018Updated 7 years ago
- Nu is a new datacenter system that enables developers to build fungible applications that can use datacenter resources wherever they are.☆41May 14, 2024Updated last year
- FPGA-based HyperLogLog Accelerator☆12Jul 13, 2020Updated 5 years ago
- Towards Hardware and Software Continuous Integration☆13Jun 8, 2020Updated 5 years ago
- Clust_mgr is an important compnent of KunlunBase. It provides a HTTP API for KunlunBase users to do cluster management, provisioning and …☆10Jun 13, 2023Updated 2 years ago
- A Fusion Code Generator for NVIDIA GPUs (commonly known as "nvFuser")☆379Updated this week
- Ongoing research training transformer models at scale☆37Feb 20, 2026Updated last week
- Lumina is a user-friendly tool to test the correctness and performance of hardware network stacks.☆29Jan 8, 2024Updated 2 years ago
- Distributed Compiler based on Triton for Parallel Systems☆1,361Feb 13, 2026Updated 2 weeks ago
- A fast communication-overlapping library for tensor/expert parallelism on GPUs.☆1,261Aug 28, 2025Updated 6 months ago
- UCCL is an efficient communication library for GPUs, covering collectives, P2P (e.g., KV cache transfer, RL weight transfer), and EP (e.g…☆1,216Updated this week
- ☆19Sep 10, 2025Updated 5 months ago
- TransferBench is a utility capable of benchmarking simultaneous copies between user-specified devices (CPUs/GPUs)☆57Updated this week
- ☆11Jun 29, 2021Updated 4 years ago
- Repository for artifact evaluation of ASPLOS 2023 paper "SparseTIR: Composable Abstractions for Sparse Compilation in Deep Learning"☆25Feb 24, 2023Updated 3 years ago
- ASTRA-sim2.0: Modeling Hierarchical Networks and Disaggregated Systems for Large-model Training at Scale☆522Jan 3, 2026Updated last month
- Artifacts of EVT ASPLOS'24☆29Mar 6, 2024Updated last year
- NVIDIA Resiliency Extension is a python package for framework developers and users to implement fault-tolerant features. It improves the …☆263Feb 19, 2026Updated last week
- ☆40Feb 19, 2026Updated last week
- An experimental parallel training platform☆56Mar 25, 2024Updated last year