yashkant / padam-tensorflowLinks
Reproducing the paper "PADAM: Closing The Generalization Gap of Adaptive Gradient Methods In Training Deep Neural Networks" for the ICLR 2019 Reproducibility Challenge
☆51Updated 6 years ago
Alternatives and similar repositories for padam-tensorflow
Users that are interested in padam-tensorflow are comparing it to the libraries listed below
Sorting:
- Code for our paper: "Regularity Normalization: Neuroscience-Inspired Unsupervised Attention across Neural Network Layers".☆21Updated 3 years ago
- The implementation of paper ''Efficient Attention Network: Accelerate Attention by Searching Where to Plug''.☆20Updated 2 years ago
- Repository for the code of the paper "Neural Networks Regularization Through Class-wise Invariant Representation Learning".☆12Updated 7 years ago
- Mathematical consequences of orthogonal weights initialization and regularization in deep learning. Experiments with gain-adjusted orthog…☆17Updated 5 years ago
- Code base for SRSGD.☆29Updated 5 years ago
- Partially Adaptive Momentum Estimation method in the paper "Closing the Generalization Gap of Adaptive Gradient Methods in Training Deep …☆39Updated 2 years ago
- A pytorch implementation of Information Bottleneck GAN☆28Updated 6 years ago
- ☆61Updated 2 years ago
- Code for paper 'Minimizing FLOPs to Learn Efficient Sparse Representations' published at ICLR 2020☆20Updated 5 years ago
- Implementation of Kronecker Attention in Pytorch☆19Updated 4 years ago
- A simple implementation of a deep linear Pytorch module☆21Updated 4 years ago
- Curriculum Learning - Tensorflow☆40Updated 7 years ago
- ☆34Updated 6 years ago
- Interpolation between Residual and Non-Residual Networks, ICML 2020. https://arxiv.org/abs/2006.05749☆26Updated 5 years ago
- A pytorch implementation for the LSTM experiments in the paper: Why Gradient Clipping Accelerates Training: A Theoretical Justification f…☆46Updated 5 years ago
- [NeurIPS'19] [PyTorch] Adaptive Regularization in NN☆68Updated 5 years ago
- Automatic and Simultaneous Adjustment of Learning Rate and Momentum for Stochastic Gradient Descent☆46Updated 5 years ago
- NeurIPS 2019 Paper Implementation☆12Updated 2 years ago
- [ICLR 2020] FSPool: Learning Set Representations with Featurewise Sort Pooling☆42Updated last year
- This repository has moved to: https://github.com/tkipf/c-swm☆27Updated 5 years ago
- Pytorch implementation of Group Equivariant Capsule Networks☆29Updated 6 years ago
- Deep neural architecture research framework☆12Updated 2 years ago
- Reversible Recurrent Neural Network Pytorch Implementation☆21Updated 7 years ago
- Official Pytorch Implementation for the paper 'SUPER-ADAM: Faster and Universal Framework of Adaptive Gradients'☆17Updated 3 years ago
- Applied Sparse regularization (L1), Weight decay regularization (L2), ElasticNet, GroupLasso and GroupSparseLasso to Neuronal Network.☆38Updated 3 years ago
- NeurIPS'19: Meta-Weight-Net: Learning an Explicit Mapping For Sample Weighting (Pytorch implementation for class imbalance).☆34Updated 5 years ago
- A disciplined approach to neural network parameters - Reviewing the approach for setting Hyper parameters by Leslie Smith☆12Updated 7 years ago
- The Shape of Data: Intrinsic Distance for Comparing Data Distributions☆12Updated 5 years ago
- Implementation of Mogrifier LSTM in PyTorch☆34Updated 5 years ago
- Official code for NeurIPS paper "Combinatorial Optimization for Panoptic Segmentation: A Fully Differentiable Approach".☆16Updated 3 years ago