slowbull / DDGLinks
A PyTorch implementation of the paper "Decoupled Parallel Backpropagation with Convergence Guarantee"
☆29Updated 7 years ago
Alternatives and similar repositories for DDG
Users that are interested in DDG are comparing it to the libraries listed below
Sorting:
- ☆30Updated 5 years ago
- A compressed adaptive optimizer for training large-scale deep learning models using PyTorch☆27Updated 5 years ago
- Net2Net implementation on PyTorch for any possible vision layers.☆39Updated 8 years ago
- ☆77Updated 6 years ago
- SmoothOut: Smoothing Out Sharp Minima to Improve Generalization in Deep Learning☆23Updated 6 years ago
- Compressing Neural Networks using the Variational Information Bottleneck☆66Updated 3 years ago
- ☆142Updated 2 years ago
- SNIP: SINGLE-SHOT NETWORK PRUNING☆31Updated 7 months ago
- Code for "Picking Winning Tickets Before Training by Preserving Gradient Flow" https://openreview.net/pdf?id=SkgsACVKPH☆105Updated 5 years ago
- ☆69Updated 5 years ago
- ☆83Updated 5 years ago
- SGD and Ordered SGD codes for deep learning, SVM, and logistic regression☆36Updated 5 years ago
- ☆177Updated last year
- Code for ICML 2017 paper, SplitNet: Learning to Semantically Split Deep Networks for Parameter Reduction and Model Parallelization☆54Updated 8 years ago
- SNIP: SINGLE-SHOT NETWORK PRUNING BASED ON CONNECTION SENSITIVITY☆115Updated 6 years ago
- Code for "EigenDamage: Structured Pruning in the Kronecker-Factored Eigenbasis" https://arxiv.org/abs/1905.05934☆113Updated 5 years ago
- Code for paper "SWALP: Stochastic Weight Averaging forLow-Precision Training".☆62Updated 6 years ago
- "Layer-wise Adaptive Rate Scaling" in PyTorch☆87Updated 4 years ago
- ☆46Updated 5 years ago
- This repository contains code to replicate the experiments given in NeurIPS 2019 paper "One ticket to win them all: generalizing lottery …☆50Updated last year
- Code to reproduce some of the figures in the paper "On Large-Batch Training for Deep Learning: Generalization Gap and Sharp Minima"☆145Updated 8 years ago
- Collection of algorithms for approximating Fisher Information Matrix for Natural Gradient (and second order method in general)☆141Updated 6 years ago
- PyTorch code for training neural networks without global back-propagation☆165Updated 6 years ago
- ☆27Updated 7 years ago
- Discovering Neural Wirings (https://arxiv.org/abs/1906.00586)☆136Updated 5 years ago
- Learning Sparse Neural Networks through L0 regularization☆244Updated 5 years ago
- Lua implementation of Entropy-SGD☆81Updated 7 years ago
- This project is the Torch implementation of our accepted AAAI 2018 paper : orthogonal weight normalization method for solving orthogonali…☆57Updated 5 years ago
- NTK reading group☆87Updated 5 years ago
- This repository is no longer maintained. Check☆81Updated 5 years ago