CCorfield / Torch-parallel-nccl-MPS-Example
Example of multi-process, multi-GPU training using Torch-parallel, nVidia-nccl, and nVidia-MPS
☆17Updated 8 years ago
Alternatives and similar repositories for Torch-parallel-nccl-MPS-Example:
Users that are interested in Torch-parallel-nccl-MPS-Example are comparing it to the libraries listed below
- image to column☆30Updated 10 years ago
- RDMA Optimization on MXNet☆14Updated 7 years ago
- Artifacts for SOSP'19 paper Optimizing Deep Learning Computation with Automatic Generation of Graph Substitutions☆21Updated 3 years ago
- Kernel Fusion and Runtime Compilation Based on NNVM☆70Updated 8 years ago
- This is a PyTorch implementation of the Scalpel. Node pruning for five benchmark networks and SIMD-aware weight pruning for LeNet-300-100…☆41Updated 6 years ago
- Implementation of Parameter Server using PyTorch communication lib☆42Updated 6 years ago
- implement distributed machine learning with Pytorch + OpenMPI☆51Updated 6 years ago
- Training deep neural networks with low precision multiplications☆63Updated 9 years ago
- Training neural networks with 8-bit computations☆28Updated 9 years ago
- This repository contains the results and code for the MLPerf™ Training v0.6 benchmark.☆42Updated last year
- ☆47Updated 5 years ago
- ☆53Updated 7 years ago
- Test winograd convolution written in TVM for CUDA and AMDGPU☆41Updated 6 years ago
- torch bindings for nccl☆28Updated 7 years ago
- Machine Learning System☆14Updated 4 years ago
- This is the (evolving) reading list for the seminar.☆59Updated 4 years ago
- ☆82Updated 2 years ago
- Move to https://github.com/apache/incubator-tvm-site☆26Updated 4 years ago
- A Tool for Automatic Parallelization of Deep Learning Training in Distributed Multi-GPU Environments.☆130Updated 3 years ago
- PyProf2: PyTorch Profiling tool☆82Updated 4 years ago
- A prototype implementation of AllReduce collective communication routine.☆19Updated 6 years ago
- ☆12Updated 6 years ago
- An analytical performance modeling tool for deep neural networks.☆88Updated 4 years ago
- This repository contains the results and code for the MLPerf™ Training v0.5 benchmark.☆35Updated last year
- PipeTransformer: Automated Elastic Pipelining for Distributed Training of Large-scale Models. ICML 2021☆56Updated 3 years ago
- Fairring (FAIR + Herring) is a plug-in for PyTorch that provides a process group for distributed training that outperforms NCCL at large …☆65Updated 3 years ago
- ☆13Updated 5 years ago
- ddl-benchmarks: Benchmarks for Distributed Deep Learning☆37Updated 4 years ago
- GPU-specialized parameter server for GPU machine learning.☆101Updated 7 years ago
- ParaDnn: A systematic performance analysis methodology for deep learning.☆39Updated 5 years ago