CCorfield / Torch-parallel-nccl-MPS-Example
Example of multi-process, multi-GPU training using Torch-parallel, nVidia-nccl, and nVidia-MPS
☆14Updated 7 years ago
Related projects: ⓘ
- torch bindings for nccl☆30Updated 6 years ago
- ☆28Updated 6 years ago
- ☆47Updated 4 years ago
- Training deep neural networks with low precision multiplications☆63Updated 9 years ago
- image to column☆31Updated 10 years ago
- Distributed Learning by Pair-Wise Averaging☆53Updated 6 years ago
- This is a PyTorch implementation of the Scalpel. Node pruning for five benchmark networks and SIMD-aware weight pruning for LeNet-300-100…☆38Updated 5 years ago
- Training wide residual networks for deployment using a single bit for each weight☆36Updated 4 years ago
- TensorFlow util for building memory usage timeline from LOG_MEMORY messages☆65Updated 6 years ago
- Code for ICML 2017 paper, SplitNet: Learning to Semantically Split Deep Networks for Parameter Reduction and Model Parallelization☆55Updated 6 years ago
- PyProf2: PyTorch Profiling tool☆83Updated 4 years ago
- Just-in-time Dynamic Batching with MXNet Gluon.☆52Updated 4 years ago
- OpenCL Inference Engine for pytorch☆51Updated 6 years ago
- Deep learning with a multiplication budget☆47Updated 6 years ago
- One-Shot Learning using Nearest-Neighbor Search (NNS) and Locality-Sensitive Hashing LSH☆72Updated 6 years ago
- Tools to convert Caffe models to neon's serialization format☆39Updated last year
- ☆23Updated 8 years ago
- This repository contains the results and code for the MLPerf™ Training v0.6 benchmark.☆42Updated last year
- Wide-residual network implementations. Best result for cifar10(97.12%), cifar100(84.12%), and other kaggle challenges☆37Updated 7 years ago
- Move to https://github.com/apache/incubator-tvm-site☆27Updated 3 years ago
- Direct C++ Interface to PyTorch☆80Updated 6 years ago
- Test winograd convolution written in TVM for CUDA and AMDGPU☆39Updated 5 years ago
- MPI for Torch☆61Updated 7 years ago
- Sublinear memory optimization for deep learning, reduce GPU memory cost to train deeper nets☆28Updated 8 years ago
- Training neural networks with 8-bit computations☆29Updated 8 years ago
- Artifacts for SOSP'19 paper Optimizing Deep Learning Computation with Automatic Generation of Graph Substitutions☆21Updated 2 years ago
- Source code for ``Neural Networks with Few Multiplications'' published at ICLR 2016☆81Updated 8 years ago
- The latest version of Net-Trim which solves the actual constrained problem☆24Updated 4 years ago
- This repository contains the results and code for the MLPerf™ Training v0.5 benchmark.☆35Updated last year
- An analytical performance modeling tool for deep neural networks.☆85Updated 3 years ago