CCorfield / Torch-parallel-nccl-MPS-Example
Example of multi-process, multi-GPU training using Torch-parallel, nVidia-nccl, and nVidia-MPS
☆16Updated 8 years ago
Alternatives and similar repositories for Torch-parallel-nccl-MPS-Example:
Users that are interested in Torch-parallel-nccl-MPS-Example are comparing it to the libraries listed below
- Training deep neural networks with low precision multiplications☆63Updated 9 years ago
- image to column☆30Updated 10 years ago
- ☆47Updated 5 years ago
- implement distributed machine learning with Pytorch + OpenMPI☆51Updated 5 years ago
- Artifacts for SOSP'19 paper Optimizing Deep Learning Computation with Automatic Generation of Graph Substitutions☆21Updated 2 years ago
- An analytical performance modeling tool for deep neural networks.☆88Updated 4 years ago
- Kernel Fusion and Runtime Compilation Based on NNVM☆70Updated 8 years ago
- Test winograd convolution written in TVM for CUDA and AMDGPU☆40Updated 6 years ago
- torch bindings for nccl☆29Updated 6 years ago
- Code for ICML 2017 paper, SplitNet: Learning to Semantically Split Deep Networks for Parameter Reduction and Model Parallelization☆54Updated 7 years ago
- ☆28Updated 7 years ago
- Implementation of Parameter Server using PyTorch communication lib☆43Updated 5 years ago
- PyProf2: PyTorch Profiling tool☆82Updated 4 years ago
- Source code for ``Neural Networks with Few Multiplications'' published at ICLR 2016☆81Updated 8 years ago
- Just-in-time Dynamic Batching with MXNet Gluon.☆52Updated 4 years ago
- This repository contains the results and code for the MLPerf™ Training v0.6 benchmark.☆42Updated last year
- SelectiveBackprop accelerates training by dynamically prioritizing useful examples with high loss☆32Updated 4 years ago
- ☆20Updated 7 years ago
- RDMA Optimization on MXNet☆14Updated 7 years ago
- Implementation of Neural Arithmetic Logic Units (https://arxiv.org/pdf/1808.00508.pdf)☆31Updated 6 years ago
- Caffe re-implementation of dynamic network surgery.☆18Updated 6 years ago
- Training neural networks with 8-bit computations☆28Updated 8 years ago
- This is a PyTorch implementation of the Scalpel. Node pruning for five benchmark networks and SIMD-aware weight pruning for LeNet-300-100…☆41Updated 6 years ago
- ☆53Updated 7 years ago
- ☆30Updated 8 years ago
- ☆23Updated 8 years ago
- MobiRNN code for the 1st International Workshop on Embedded and Mobile Deep Learning☆8Updated 7 years ago
- ☆12Updated 6 years ago
- OpenCL Inference Engine for pytorch☆51Updated 7 years ago
- A Tool for Automatic Parallelization of Deep Learning Training in Distributed Multi-GPU Environments.☆130Updated 2 years ago