ray-project / pygloo
Pygloo provides Python bindings for Gloo.
☆20Updated 3 months ago
Alternatives and similar repositories for pygloo:
Users that are interested in pygloo are comparing it to the libraries listed below
- Tracking Ray Enhancement Proposals☆48Updated last month
- Distributed ML Optimizer☆30Updated 3 years ago
- A performant, memory-efficient checkpointing library for PyTorch applications, designed with large, complex distributed workloads in mind…☆154Updated 2 months ago
- Deadline-based hyperparameter tuning on RayTune.☆31Updated 5 years ago
- Ray-based Apache Beam runner☆43Updated last year
- WIP. Veloce is a low-code Ray-based parallelization library that makes machine learning computation novel, efficient, and heterogeneous.☆18Updated 2 years ago
- A framework for PyTorch to enable fault management for collective communication libraries (CCL) such as NCCL☆19Updated this week
- ☆31Updated 2 years ago
- A resilient distributed training framework☆88Updated 10 months ago
- Fairring (FAIR + Herring) is a plug-in for PyTorch that provides a process group for distributed training that outperforms NCCL at large …☆64Updated 2 years ago
- A library that translates Python and NumPy to optimized distributed systems code.☆132Updated 2 years ago
- Python bindings for UCX☆125Updated last week
- ML Input Data Processing as a Service. This repository contains the source code for Cachew (built on top of TensorFlow).☆36Updated 5 months ago
- A minimal shared memory object store design☆49Updated 8 years ago
- (NeurIPS 2022) Automatically finding good model-parallel strategies, especially for complex models and clusters.☆37Updated 2 years ago
- WholeGraph - large scale Graph Neural Networks☆101Updated 2 months ago
- extensible collectives library in triton☆83Updated 4 months ago
- Modyn is a research-platform for training ML models on growing datasets.☆43Updated this week
- Training neural networks in TensorFlow 2.0 with 5x less memory☆130Updated 2 years ago
- MLPerf™ logging library☆32Updated this week
- MSCCL++: A GPU-driven communication stack for scalable AI applications☆297Updated this week
- A Python library transfers PyTorch tensors between CPU and NVMe☆104Updated 2 months ago
- CUDA checkpoint and restore utility☆289Updated 3 weeks ago
- A schedule language for large model training☆144Updated 8 months ago
- sensAI: ConvNets Decomposition via Class Parallelism for Fast Inference on Live Data☆64Updated 6 months ago
- Fine-grained GPU sharing primitives☆141Updated 4 years ago
- ☆15Updated last year
- Code for "Heterogenity-Aware Cluster Scheduling Policies for Deep Learning Workloads", which appeared at OSDI 2020☆126Updated 6 months ago
- Home for OctoML PyTorch Profiler☆107Updated last year
- PArametrized Recommendation and Ai Model benchmark is a repository for development of numerous uBenchmarks as well as end to end nets for…☆128Updated this week