Collective communications library with various primitives for multi-machine training.
☆1,405Mar 11, 2026Updated last week
Alternatives and similar repositories for gloo
Users that are interested in gloo are comparing it to the libraries listed below
Sorting:
- Optimized primitives for collective multi-GPU communication☆4,531Updated this week
- ☆601Apr 6, 2018Updated 7 years ago
- A high performance and generic framework for distributed DNN training☆3,716Oct 3, 2023Updated 2 years ago
- Distributed training framework for TensorFlow, Keras, PyTorch, and Apache MXNet.☆14,679Dec 1, 2025Updated 3 months ago
- NCCL Tests☆1,459Mar 11, 2026Updated last week
- oneAPI Collective Communications Library (oneCCL)☆257Feb 4, 2026Updated last month
- ☆371Oct 23, 2017Updated 8 years ago
- A tensor-aware point-to-point communication primitive for machine learning☆284Dec 17, 2025Updated 3 months ago
- A domain specific language to express machine learning workloads.☆1,764Apr 28, 2023Updated 2 years ago
- A fast GPU memory copy library based on NVIDIA GPUDirect RDMA technology☆1,355Mar 12, 2026Updated last week
- Acceleration package for neural networks on multi-core CPUs☆1,702Jun 11, 2024Updated last year
- Compiler for Neural Network hardware accelerators☆3,326May 11, 2024Updated last year
- ☆391Apr 23, 2024Updated last year
- RDMA and SHARP plugins for nccl library☆224Jan 12, 2026Updated 2 months ago
- A PyTorch Extension: Tools for easy mixed precision and distributed training in Pytorch☆8,936Updated this week
- FB (Facebook) + GEMM (General Matrix-Matrix Multiplication) - https://code.fb.com/ml-applications/fbgemm/☆1,543Updated this week
- PyTorch extensions for high performance and large scale training.☆3,403Apr 26, 2025Updated 10 months ago
- common in-memory tensor structure☆1,177Jan 26, 2026Updated last month
- Open Machine Learning Compiler Framework☆13,197Updated this week
- CUDA Templates and Python DSLs for High-Performance Linear Algebra☆9,442Updated this week
- Unified Communication X (mailing list - https://elist.ornl.gov/mailman/listinfo/ucx-group)☆1,596Updated this week
- Automatically Discovering Fast Parallelization Strategies for Distributed Deep Neural Network Training☆1,864Mar 12, 2026Updated last week
- A lightweight parameter server interface☆1,561Mar 2, 2026Updated 2 weeks ago
- Ongoing research training transformer models at scale☆15,744Updated this week
- Reliable Allreduce and Broadcast Interface for distributed machine learning☆514Nov 5, 2020Updated 5 years ago
- ATen: A TENsor library for C++11☆717Nov 20, 2019Updated 6 years ago
- ☆1,653Sep 11, 2018Updated 7 years ago
- Development repository for the Triton language and compiler☆18,656Mar 14, 2026Updated last week
- Microsoft Collective Communication Library☆387Sep 20, 2023Updated 2 years ago
- [DEPRECATED] Moved to ROCm/rocm-systems repo☆413Updated this week
- oneAPI Deep Neural Network Library (oneDNN)☆3,964Updated this week
- NCCL Fast Socket is a transport layer plugin to improve NCCL collective communication performance on Google Cloud.☆122Nov 15, 2023Updated 2 years ago
- Unified Collective Communication Library☆296Mar 12, 2026Updated last week
- PyTorch elastic training☆729Jun 15, 2022Updated 3 years ago
- MSCCL++: A GPU-driven communication stack for scalable AI applications☆490Updated this week
- A GPU-accelerated library containing highly optimized building blocks and an execution engine for data processing to accelerate deep lear…☆5,642Mar 13, 2026Updated last week
- [ARCHIVED] Cooperative primitives for CUDA C++. See https://github.com/NVIDIA/cccl☆1,821Oct 9, 2023Updated 2 years ago
- Reference implementations of MLPerf® training benchmarks☆1,747Mar 12, 2026Updated last week
- Open MPI main development repository☆2,549Updated this week