slowbull / DDGLinks
A PyTorch implementation of the paper "Decoupled Parallel Backpropagation with Convergence Guarantee"
☆30Updated 7 years ago
Alternatives and similar repositories for DDG
Users that are interested in DDG are comparing it to the libraries listed below
Sorting:
- ☆32Updated 5 years ago
- A compressed adaptive optimizer for training large-scale deep learning models using PyTorch☆25Updated 6 years ago
- ☆77Updated 6 years ago
- Compressing Neural Networks using the Variational Information Bottleneck☆66Updated 3 years ago
- Net2Net implementation on PyTorch for any possible vision layers.☆39Updated 8 years ago
- ☆83Updated 6 years ago
- ☆46Updated 5 years ago
- ☆145Updated 2 years ago
- SmoothOut: Smoothing Out Sharp Minima to Improve Generalization in Deep Learning☆23Updated 7 years ago
- Code for "Picking Winning Tickets Before Training by Preserving Gradient Flow" https://openreview.net/pdf?id=SkgsACVKPH☆105Updated 5 years ago
- SNIP: SINGLE-SHOT NETWORK PRUNING☆31Updated 10 months ago
- PyTorch code for training neural networks without global back-propagation☆167Updated 6 years ago
- Zero-Shot Knowledge Distillation in Deep Networks☆67Updated 3 years ago
- SGD and Ordered SGD codes for deep learning, SVM, and logistic regression☆36Updated 5 years ago
- Library to manage machine learning problems as `Tasks' and to sample from Task distributions. Includes Tensorflow implementation of impli…☆50Updated 4 years ago
- Code for ICML 2017 paper, SplitNet: Learning to Semantically Split Deep Networks for Parameter Reduction and Model Parallelization☆54Updated 8 years ago
- Learning Sparse Neural Networks through L0 regularization☆248Updated 5 years ago
- Code for paper "SWALP: Stochastic Weight Averaging forLow-Precision Training".☆62Updated 6 years ago
- ☆69Updated 5 years ago
- Scripts for Imagenet 32 dataset☆155Updated 4 years ago
- "Layer-wise Adaptive Rate Scaling" in PyTorch☆87Updated 5 years ago
- ☆27Updated 7 years ago
- Discovering Neural Wirings (https://arxiv.org/abs/1906.00586)☆136Updated 3 weeks ago
- Gradient Starvation: A Learning Proclivity in Neural Networks☆61Updated 5 years ago
- This repository contains code to replicate the experiments given in NeurIPS 2019 paper "One ticket to win them all: generalizing lottery …☆50Updated last year
- Implementation of (overlap) local SGD in Pytorch☆34Updated 5 years ago
- ☆178Updated last year
- Stochastic Gradient Push for Distributed Deep Learning☆170Updated 2 years ago
- Code to reproduce some of the figures in the paper "On Large-Batch Training for Deep Learning: Generalization Gap and Sharp Minima"☆145Updated 8 years ago
- [ICML 2018] "Deep k-Means: Re-Training and Parameter Sharing with Harder Cluster Assignments for Compressing Deep Convolutions"☆152Updated 4 years ago