alexrenz / AdaPMLinks
A fully adaptive, zero-tuning parameter manager that enables efficient distributed machine learning training
☆20Updated 2 years ago
Alternatives and similar repositories for AdaPM
Users that are interested in AdaPM are comparing it to the libraries listed below
Sorting:
- Light-weight GPU kernel interface for graph operations☆15Updated 5 years ago
- Runtime Tracing Library for TensorFlow☆43Updated 6 years ago
- A Ray-based data loader with per-epoch shuffling and configurable pipelining, for shuffling and loading training data for distributed tra…☆18Updated 2 years ago
- BytePS examples (Vision, NLP, GAN, etc)☆19Updated 2 years ago
- PyTorch-Direct code on top of PyTorch-1.8.0nightly (e152ca5) for Large Graph Convolutional Network Training with GPU-Oriented Data Commun…☆44Updated last year
- ☆53Updated last year
- Machine Learning System☆14Updated 5 years ago
- Fairring (FAIR + Herring) is a plug-in for PyTorch that provides a process group for distributed training that outperforms NCCL at large …☆65Updated 3 years ago
- High performance RDMA-based distributed feature collection component for training GNN model on EXTREMELY large graph☆54Updated 2 years ago
- ☆21Updated 2 years ago
- OpenEmbedding is an open source framework for Tensorflow distributed training acceleration.☆32Updated 2 years ago
- PSTensor provides a way to hack the memory management of tensors in TensorFlow and PyTorch by defining your own C++ Tensor Class.☆10Updated 3 years ago
- DMALab's reading group slides and papers.☆16Updated 4 years ago
- ddl-benchmarks: Benchmarks for Distributed Deep Learning☆37Updated 5 years ago
- Artifacts for SOSP'19 paper Optimizing Deep Learning Computation with Automatic Generation of Graph Substitutions☆21Updated 3 years ago
- A Generic Resource-Aware Hyperparameter Tuning Execution Engine☆15Updated 3 years ago
- ☆43Updated last year
- FTPipe and related pipeline model parallelism research.☆41Updated 2 years ago
- Deadline-based hyperparameter tuning on RayTune.☆31Updated 5 years ago
- Development repository for integrating FlexFlow (A distributed deep learning framework that supports flexible parallelization strategies)…☆29Updated 3 years ago
- A library for syntactically rewriting Python programs, pronounced (sinner).☆69Updated 3 years ago
- Vector search with bounded performance.☆35Updated last year
- ☆16Updated 2 years ago
- This is the (evolving) reading list for the seminar.☆58Updated 4 years ago
- High performance NCCL plugin for Bagua.☆15Updated 3 years ago
- ☆32Updated 2 years ago
- Crossbow: A Multi-GPU Deep Learning System for Training with Small Batch Sizes☆55Updated 2 years ago
- this is the release repository of superneurons☆52Updated 4 years ago
- RDMA Optimization on MXNet☆14Updated 7 years ago
- Graph Challenge☆31Updated 5 years ago