yashkant / padam-tensorflowLinks
Reproducing the paper "PADAM: Closing The Generalization Gap of Adaptive Gradient Methods In Training Deep Neural Networks" for the ICLR 2019 Reproducibility Challenge
☆51Updated 6 years ago
Alternatives and similar repositories for padam-tensorflow
Users that are interested in padam-tensorflow are comparing it to the libraries listed below
Sorting:
- ☆34Updated 6 years ago
- ☆61Updated 2 years ago
- Official PyTorch implementation of the paper : ProbAct: A Probabilistic Activation Function for Deep Neural Networks.☆13Updated 6 years ago
- Code base for SRSGD.☆29Updated 5 years ago
- Code for our paper: "Regularity Normalization: Neuroscience-Inspired Unsupervised Attention across Neural Network Layers".☆21Updated 3 years ago
- The implementation of paper ''Efficient Attention Network: Accelerate Attention by Searching Where to Plug''.☆20Updated 2 years ago
- A pytorch implementation for the LSTM experiments in the paper: Why Gradient Clipping Accelerates Training: A Theoretical Justification f…☆46Updated 5 years ago
- [NeurIPS'19] [PyTorch] Adaptive Regularization in NN☆68Updated 5 years ago
- A pytorch implementation of Information Bottleneck GAN☆28Updated 6 years ago
- Partially Adaptive Momentum Estimation method in the paper "Closing the Generalization Gap of Adaptive Gradient Methods in Training Deep …☆39Updated 2 years ago
- Code release to reproduce ASHA experiments from "Random Search and Reproducibility for NAS."☆22Updated 5 years ago
- Repository for the code of the paper "Neural Networks Regularization Through Class-wise Invariant Representation Learning".☆12Updated 7 years ago
- Mathematical consequences of orthogonal weights initialization and regularization in deep learning. Experiments with gain-adjusted orthog…☆17Updated 6 years ago
- NeurIPS 2019 Paper Implementation☆12Updated 2 years ago
- Statistical adaptive stochastic optimization methods☆32Updated 5 years ago
- testing multi gpu for pytorch☆26Updated 6 years ago
- PyTorch implementation of "Improved Training of Wasserstein GANs", arxiv:1704.00028☆27Updated 7 years ago
- [ICLR 2019] Learning Representations of Sets through Optimized Permutations☆36Updated 6 years ago
- Official code for NeurIPS paper "Combinatorial Optimization for Panoptic Segmentation: A Fully Differentiable Approach".☆16Updated 3 years ago
- PyTorch Examples repo for "ReZero is All You Need: Fast Convergence at Large Depth"☆62Updated last year
- Automatic and Simultaneous Adjustment of Learning Rate and Momentum for Stochastic Gradient Descent☆46Updated 5 years ago
- Code for ICLR2018 paper: Improving GAN Training via Binarized Representation Entropy (BRE) Regularization - Y. Cao · W Ding · Y.C. Lui · …☆20Updated 7 years ago
- Reversible Recurrent Neural Network Pytorch Implementation☆21Updated 7 years ago
- Repository containing code for getting statistical guarantees on properties of BNNs☆13Updated 6 years ago
- Repository with code for paper "Inhibited Softmax for Uncertainty Estimation in Neural Networks"☆25Updated 6 years ago
- ☆25Updated 3 years ago
- Code for Self-Tuning Networks (ICLR 2019) https://arxiv.org/abs/1903.03088☆54Updated 6 years ago
- Unofficial pytorch implementation of ReZero in ResNet☆24Updated 5 years ago
- Anonymous Repository for ICML LRG Workshop: On Explainability Techniques for Graph Convolutional Networks☆23Updated 6 years ago
- Deep Learning using Rectified Linear Units (ReLU)☆22Updated last year